Fengling Chen

Functional Scaling Laws in Kernel Regression: Loss Dynamics and Learning Rate Schedules

Scaling laws have emerged as a unifying lens for understanding and guiding the training of large language models (LLMs). However, existing studies predominantly focus on the final-step loss, leaving open whether the entire $\textit{loss dynamics}$ obey similar laws and, crucially, how the $\textit{…