Xingyue Guo

Grow-on-Demand: Sparse and Adaptive Expert Expansion for Continual Instruction Tuning

Continual instruction tuning aims to incrementally adapt large language models to new tasks without forgetting previously acquired knowledge. Existing approaches often struggle to balance plasticity and stability. Replay-based methods retrain on historical data, which raises privacy concerns. Archit