2023
Random Reshuffling with Variance Reduction: New Analysis and Better Rates
UAI 2023poster
Virtually all state-of-the-art methods for training supervised machine learning models are variants of Stochastic Gradient Descent (SGD), enhanced with a number of additional tricks, such as minibatching, momentum, and adaptive stepsizes. However, one of the most basic questions in the design of su…