2023
Agnostic Learning of General ReLU Activation Using Gradient Descent
ICLR 2023poster
We provide a convergence analysis of gradient descent for the problem of agnostically learning a single ReLU function under Gaussian distributions. Unlike prior work that studies the setting of zero bias, we consider the more challenging scenario when the bias of the ReLU function is non-zero. Our m…