Ian Pelakh

Minimum norm interpolation by perceptra: Explicit regularization and implicit bias

We investigate how shallow ReLU networks interpolate between known regions. Our analysis shows that empirical risk minimizers converge to a minimum norm interpolant as the number of data points and parameters tends to infinity when a weight decay regularizer is penalized with a coefficient which van…