2018
Loss Surfaces, Mode Connectivity, and Fast Ensembling of DNNs
NeurIPS 2018spotlight
The loss functions of deep neural networks are complex and their geometric properties are not well understood. We show that the optima of these complex loss functions are in fact connected by simple curves, over which training and test accuracy are nearly constant. We introduce a training procedur…