Osane Hackel

Debiasing Mini-Batch Quadratics for Applications in Deep Learning

Quadratic approximations form a fundamental building block of machine learning methods. E.g., second-order optimizers try to find the Newton step into the minimum of a local quadratic proxy to the objective function; and the second-order approximation of a network's loss function can be used to quan…