2023
Does Momentum Help in Stochastic Optimization? A Sample Complexity Analysis.
UAI 2023poster
Stochastic Heavy Ball (SHB) and Nesterov’s Accelerated Stochastic Gradient (ASG) are popular momentum methods in optimization. While the benefits of these acceleration ideas in deterministic settings are well understood, their advantages in stochastic optimization are unclear. Several works have rec…