Abhinav Ganesh

On the geometry of generalization and memorization in deep neural networks

Understanding how large neural networks avoid memorizing training data is key to explaining their high generalization performance. To examine the structure of when and where memorization occurs in a deep network, we use a recently developed replica-based mean field theoretic geometric analysis metho…