MohammadReza Davari*

Model Breadcrumbs: Scaling Multi-Task Model Merging with Sparse Masks

"The rapid development of AI systems has been greatly influenced by the emergence of foundation models. A common approach for targeted problems involves fine-tuning these pre-trained foundation models for specific target tasks, resulting in a rapid spread of models fine-tuned across a diverse array…