Chico Q. Camargo

Deep learning generalizes because the parameter-function map is biased towards simple functions

Deep neural networks (DNNs) generalize remarkably well without explicit regularization even in the strongly over-parametrized regime where classical learning theory would instead predict that they would severely overfit. While many proposals for some kind of implicit regularization have been made…