Brandon Livio Annesi

Overparametrization bends the landscape: BBP transitions at initialization in simple Neural Networks

High-dimensional non-convex loss landscapes play a central role in the theory of Machine Learning. Gaining insight into how these landscapes interact with gradient-based optimization methods, even in relatively simple models, can shed light on this enigmatic feature of neural networks. In this work,…