2026
LoRA-S: An Efficient Low Rank Adaptation scheme via Sylvester equation
ICLR 2026poster
Numerous studies on low-rank adaptation (LoRA) emerged in recent years, with the aim of accelerating the convergence of the LoRA framework. In this paper, we leverage the horizontal lift theory from differential geometry to establish the general iteration scheme on the quotient manifold \mathbb{R}\…