2024
The effect of Leaky ReLUs on the training and generalization of overparameterized networks
AISTATS 2024poster
We investigate the training and generalization errors of overparameterized neural networks (NNs) with a wide class of leaky rectified linear unit (ReLU) functions. More specifically, we carefully upper bound both the convergence rate of the training error and the generalization error of such NNs and…