2025
KaSA: Knowledge-Aware Singular-Value Adaptation of Large Language Models
ICLR 2025poster
The increasing sizes of large language models (LLMs) result in significant computational overhead and memory usage when adapting these models to specific tasks or domains. Various parameter-efficient fine-tuning (PEFT) methods have been devised to mitigate these challenges by training a small set of…