Rotem Zamir Aviv

Asynchronous Distributed Learning : Adapting to Gradient Delays without Prior Knowledge

We consider stochastic convex optimization problems, where several machines act asynchronously in parallel while sharing a common memory. We propose a robust training method for the constrained setting and derive non asymptotic convergence guarantees that do not depend on prior knowledge of update d…