2024
Benign overfitting in leaky ReLU networks with moderate input dimension
NeurIPS 2024spotlight
The problem of benign overfitting asks whether it is possible for a model to perfectly fit noisy training data and still generalize well. We study benign overfitting in two-layer leaky ReLU networks trained with the hinge loss on a binary classification task. We consider input data which can be deco…