Joshua Cutler

Stochastic optimization under time drift: iterate averaging, step-decay schedules, and high probability guarantees

We consider the problem of minimizing a convex function that is evolving in time according to unknown and possibly stochastic dynamics. Such problems abound in the machine learning and signal processing literature, under the names of concept drift and stochastic tracking. We provide novel non-asympt…