← Search

Fred Hamprecht

4 accepted papers

2019

On the Spectral Bias of Neural Networks

ICML 2019oral

Neural networks are known to be a class of highly expressive functions able to fit even random input-output mappings with 100% accuracy. In this work we present properties of neural networks that complement this aspect of expressivity. By using tools from Fourier analysis, we highlight a learning bi…

2018

Essentially No Barriers in Neural Network Energy Landscape

ICML 2018oral

Training neural networks involves finding minima of a high-dimensional non-convex loss function. Relaxing from linear interpolations, we construct continuous paths between minima of recent neural network architectures on CIFAR10 and CIFAR100. Surprisingly, the paths are essentially flat in both the…