2024
Position: Understanding LLMs Requires More Than Statistical Generalization
ICML 2024spotlight
The last decade has seen blossoming research in deep learning theory attempting to answer, ``Why does deep learning generalize?" A powerful shift in perspective precipitated this progress: the study of overparametrized models in the interpolation regime. In this paper, we argue that another perspect…