2020
Landscape Connectivity and Dropout Stability of SGD Solutions for Over-parameterized Neural Networks
ICML 2020poster
The optimization of multilayer neural networks typically leads to a solution with zero training error, yet the landscape can exhibit spurious local minima and the minima can be disconnected. In this paper, we shed light on this phenomenon: we show that the combination of stochastic gradient descent…