2026
Curriculum-Guided Layer Scaling for Language Model Pretraining
ICML 2026poster
As the cost of pretraining large language models grows, there is continued interest in strategies to improve learning efficiency during this core training stage. Motivated by cognitive development, where humans gradually build knowledge as their brains mature, we propose Curriculum-Guided Layer Scal…