2020
Frequency Bias in Neural Networks for Input of Non-Uniform Density
ICML 2020poster
Recent works have partly attributed the generalization ability of over-parameterized neural networks to frequency bias – networks trained with gradient descent on data drawn from a uniform distribution find a low frequency fit before high frequency ones. As realistic training sets are not drawn from…