Jacob Solawetz

Arcee’s MergeKit: A Toolkit for Merging Large Language Models

The rapid growth of open-source language models provides the opportunity to merge model checkpoints, combining their parameters to improve performance and versatility. Advances in transfer learning have led to numerous task-specific models, which model merging can integrate into powerful multitask m…