2026
FedRot-LoRA: Mitigating Rotational Misalignment in Federated LoRA
ICML 2026poster
Federated LoRA provides a communication-efficient mechanism for fine-tuning large language models on decentralized data. In practice, however, a discrepancy between the factor-wise averaging used to preserve low rank and the mathematically correct aggregation of local updates can cause significant a…