2025
Come Together, But Not Right Now: A Progressive Strategy to Boost Low-Rank Adaptation
ICML 2025poster
Low-rank adaptation (LoRA) has emerged as a leading parameter-efficient fine-tuning technique for adapting large foundation models, yet it often locks adapters into suboptimal minima near their initialization. This hampers model generalization and limits downstream operators such as adapter merging…