Haishen Jiang

CGSVD: Cascaded Granular Singular Value Decomposition for Large Language Model Compression

The exponential growth in the parameter scale of Large Language Models (LLMs) has precipitated an urgent demand for efficient compression techniques to facilitate practical deployment. To address this challenge, low-rank decomposition based on Singular Value Decomposition (SVD) offers a principled, …