2025
MoDeGPT: Modular Decomposition for Large Language Model Compression
ICLR 2025oral
Large Language Models (LLMs) have significantly advanced AI with their exceptional performance across a wide range of tasks. However, their extensive computational requirements restrict their use on devices with limited resources. While recent compression methods based on low-rank matrices show pote…