← Search

David G.T. Barrett

2 accepted papers

2022

Why neural networks find simple solutions: The many regularizers of geometric complexity

NeurIPS 2022accept

In many contexts, simpler models are preferable to more complex models and the control of this model complexity is the goal for many methods in machine learning such as regularization, hyperparameter tuning and architecture design. In deep learning, it has been difficult to understand the underlying…

Cited by 39SourcePDFScholar
2018

On the importance of single directions for generalization

ICLR 2018poster

Despite their ability to memorize large datasets, deep neural networks often achieve good generalization performance. However, the differences between the learned solutions of networks which generalize and those which do not remain unclear. Additionally, the tuning properties of single directions (d…

Cited by 388SourcePDFScholar