2024
Stochastic Gradient Flow Dynamics of Test Risk and its Exact Solution for Weak Features
ICML 2024poster
We investigate the test risk of a continuous time stochastic gradient flow dynamics in learning theory. Using a path integral formulation we provide, in the regime of small learning rate, a general formula for computing the difference between test risk curves of pure gradient and stochastic gradient…