2026
LoRA-DA: Data-Aware Initialization for Low-Rank Adaptation via Asymptotic Analysis
ICML 2026poster
LoRA has become a widely adopted method for PEFT, and its initialization methods have attracted increasing attention. However, existing methods have notable limitations: many methods do not incorporate target-domain data, while gradient-based methods exploit data only at a shallow level by relying o…