AIMMerging: Adaptive Iterative Model Merging Using Training Trajectories for Language Model Continual Learning
Continual learning (CL) is essential for deploying large language models (LLMs) in dynamic real-world environments without the need for costly retraining. Recent model merging-based methods have attracted significant attention, but they still struggle to effectively manage the trade-off between lear