2026
When Shared Knowledge Hurts: Spectral Over-Accumulation in Model Merging
ICML 2026poster
Model merging combines multiple fine-tuned models into a single model by $\textit{adding}$ their weight updates, providing a lightweight alternative to retraining. Existing methods primarily target resolving conflicts between task updates, leaving the failure mode of over-counting shared knowledge u…