2026
Expert Merging: Model Merging with Unsupervised Expert Alignment and Importance-Guided Layer Chunking
ICLR 2026poster
Model merging, which combines multiple domain-specialized experts into a single model, offers a practical path to endow Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) with broad capabilities without the cost of joint training or serving many models. However, training-free…