Shengnan Miao

Proximal Stochastic Recursive Momentum Methods for Nonconvex Composite Decentralized Optimization

Consider a network of N decentralized computing agents collaboratively solving a nonconvex stochastic composite problem. In this work, we propose a single-loop algorithm, called DEEPSTORM, that achieves optimal sample complexity for this setting. Unlike double-loop algorithms that require a large ba…