Maxime Laborde

A Lyapunov analysis for accelerated gradient methods: from deterministic to stochastic case

Recent work by Su, Boyd and Candes made a connection between Nesterov’s accelerated gradient descent method and an ordinary differential equation (ODE). We show that this connection can be extended to the case of stochastic gradients, and develop Lyapunov function based convergence rates proof for N…