Honghe Zhang

Structured Pruning for Large Language Models Using Coupled Components Elimination and Minor Fine-tuning

Large language models (LLMs) have demonstrated powerful capabilities in natural language processing, yet their vast number of parameters poses challenges for deployment and inference efficiency. Structured model pruning emerges as a viable approach to reduce model size and accelerate inference, with…