← Search

Yanghua Jin

3 accepted papers

2020

Amortized Nesterov’s Momentum: A Robust Momentum and Its Application to Deep Learning

UAI 2020poster

This work proposes a novel momentum technique, the Amortized Nesterov’s Momentum, for stochastic convex optimization. The proposed method can be regarded as a smooth transition between Nesterov’s method and mirror descent. By tuning only a single parameter, users can trade Nesterov’s acceleration fo…

Cited by 8SourcePDFScholar