2026
Post-Hoc Merging is Not Enough: Many-Shot Model Merging with Loss-Gap Balancing
ICML 2026poster
Model merging has become a practical post-training strategy for building a single multi-task large language model (LLM) by combining multiple task-specialized models, avoiding costly joint training. However, most existing approaches rely on post-hoc merging, in which task-specific models are merged …