Ruobing Zhao

CABS: Conflict-Aware and Balanced Sparsification for Enhancing Model Merging

Model merging based on task vectors, i.e., the parameter differences between fine-tuned models and a shared base model, provides an efficient way to integrate multiple task-specific models into a multitask model without retraining. Recent works have endeavored to address the conflicts between task v…