2021
Global Convergence of Three-layer Neural Networks in the Mean Field Regime
ICLR 2021oral
In the mean field regime, neural networks are appropriately scaled so that as the width tends to infinity, the learning dynamics tends to a nonlinear and nontrivial dynamical limit, known as the mean field limit. This lends a way to study large-width neural networks via analyzing the mean field limi…