← Search

Dmitriy Drusvyatskiy

8 accepted papers

2025

Finite-Time Convergence Rates in Stochastic Stackelberg Games with Smooth Algorithmic Agents

ICML 2025poster

Decision-makers often adaptively influence downstream competitive agents' behavior to minimize their cost, yet in doing so face critical challenges: $(i)$ decision-makers might not *a priori* know the agents' objectives; $(ii)$ agents might *learn* their responses, introducing stochasticity and non…

Cited by 0SourcePDFScholar
2023

Aiming towards the minimizers: fast convergence of SGD for overparametrized problems

NeurIPS 2023poster

Modern machine learning paradigms, such as deep learning, occur in or close to the interpolation regime, wherein the number of model parameters is much larger than the number of data samples. In this work, we propose a regularity condition within the interpolation regime which endows the stochastic…

Cited by 17SourcePDFScholar
2022

A gradient sampling method with complexity guarantees for Lipschitz functions in high and low dimensions

NeurIPS 2022accept

Zhang et al. (ICML 2020) introduced a novel modification of Goldstein's classical subgradient method, with an efficiency guarantee of $O(\varepsilon^{-4})$ for minimizing Lipschitz functions. Their work, however, makes use of an oracle that is not efficiently implementable. In this paper, we obtain…

Cited by 53SourcePDFScholar
2022

Decision-Dependent Risk Minimization in Geometrically Decaying Dynamic Environments

AAAI 2022technical

This paper studies the problem of expected loss minimization given a data distribution that is dependent on the decision-maker's action and evolves dynamically in time according to a geometric decay process. Novel algorithms for both the information setting in which the decision-maker has a first o…

Cited by 45SourcePDFScholar
2022

Learning in Stochastic Monotone Games with Decision-Dependent Data

AISTATS 2022poster

Learning problems commonly exhibit an interesting feedback mechanism wherein the population data reacts to competing decision makers’ actions. This paper formulates a new game theoretic framework for this phenomenon, called multi-player performative prediction. We establish transparent sufficient co…

Cited by 20SourcePDFScholar
2021

Stochastic optimization under time drift: iterate averaging, step-decay schedules, and high probability guarantees

NeurIPS 2021poster

We consider the problem of minimizing a convex function that is evolving in time according to unknown and possibly stochastic dynamics. Such problems abound in the machine learning and signal processing literature, under the names of concept drift and stochastic tracking. We provide novel non-asympt…

Cited by 24SourcePDFScholar
2019

Iterative Linearized Control: Stable Algorithms and Complexity Guarantees

ICML 2019oral

We examine popular gradient-based algorithms for nonlinear control in the light of the modern complexity analysis of first-order optimization algorithms. The examination reveals that the complexity bounds can be clearly stated in terms of calls to a computational oracle related to dynamic programmin…

Cited by 27SourcePDFScholar
2018

Catalyst for Gradient-based Nonconvex Optimization

AISTATS 2018poster

We introduce a generic scheme to solve nonconvex optimization problems using gradient-based algorithms originally designed for minimizing convex functions. Even though these methods may originally require convexity to operate, the proposed approach allows one to use them without assuming any knowled…

Cited by 0SourcePDFScholar