2024
Symmetries in Overparametrized Neural Networks: A Mean Field View
NeurIPS 2024spotlight
We develop a Mean-Field (MF) view of the learning dynamics of overparametrized Artificial Neural Networks (NN) under distributional symmetries of the data w.r.t. the action of a general compact group $G$. We consider for this a class of generalized shallow NNs given by an ensemble of $N$ multi-lay…