SyMerge: From Non-Interference to Synergistic Merging via Single-Layer Adaptation
Model merging combines independently trained models into a single multi-task model. However, most existing approaches focus primarily on avoiding task interference. We argue that its greater potential lies in enabling task synergy, where tasks actively improve one another. We identify cross-task per…