2026
Weak Correlations as the Underlying Principle for Linearization of Gradient-Based Learning Systems
ICLR 2026poster
Deep learning models, such as wide neural networks, can be viewed as nonlinear dynamical systems composed of numerous interacting degrees of freedom. When such systems approach the limit of infinite number of degrees of freedom, their dynamics tend to simplify. This paper investigates gradient desce…