2022
Asynchronous Distributed Optimization with Stochastic Delays
AISTATS 2022poster
We study asynchronous finite sum minimization in a distributed-data setting with a central parameter server. While asynchrony is well understood in parallel settings where the data is accessible by all machines—e.g., modifications of variance-reduced gradient algorithms like SAGA work well—little is…