Kai Lei

Multi-Task Model Fusion via Adaptive Merging

Multi-task model fusion (MTMF) aims to integrate the capabilities of individual models into a unified model. Past approaches either require extensive training and fine-tuning or necessitate that models share the same pre-training and initialization. Recently, several fusion methods have been propose…