← Search

Benjamin Edelman

2 accepted papers

2019

SGD on Neural Networks Learns Functions of Increasing Complexity

NeurIPS 2019spotlight

We perform an experimental study of the dynamics of Stochastic Gradient Descent (SGD) in learning deep neural networks for several real and synthetic classification tasks. We show that in the initial epochs, almost all of the performance improvement of the classifier obtained by SGD can be explained…