2021
On the geometry of generalization and memorization in deep neural networks
ICLR 2021poster
Understanding how large neural networks avoid memorizing training data is key to explaining their high generalization performance. To examine the structure of when and where memorization occurs in a deep network, we use a recently developed replica-based mean field theoretic geometric analysis metho…