← Search

Sébastien Arnold

2 accepted papers

2019

Reducing the variance in online optimization by transporting past gradients

NeurIPS 2019spotlight

Most stochastic optimization methods use gradients once before discarding them. While variance reduction methods have shown that reusing past gradients can be beneficial when there is a finite number of datapoints, they do not easily extend to the online setting. One issue is the staleness due to us…