2025
PoLAR: Polar-Decomposed Low-Rank Adapter Representation
NeurIPS 2025poster
We show that low-rank adaptation of large-scale models suffers from a low stable rank that is well below the linear algebraic rank of the subspace, degrading fine-tuning performance. To mitigate the underutilization of the allocated subspace, we propose PoLAR, a parameterization inspired by the pola…