2026
Investigating Continual Pretraining in Large Language Models: Insights and Implications
ICML 2026poster
Continual learning (CL) in large language models (LLMs) is an evolving domain that focuses on developing efficient and sustainable training strategies to adapt models to emerging knowledge and achieve robustness in dynamic environments. Our primary emphasis is on continual domain-adaptive pretrainin…