← Search

Zhaosong Lu

2 accepted papers

2024

Single-Loop Stochastic Algorithms for Difference of Max-Structured Weakly Convex Functions

NeurIPS 2024poster

In this paper, we study a class of non-smooth non-convex problems in the form of $\min_{x}[\max_{y\in\mathcal Y}\phi(x, y) - \max_{z\in\mathcal Z}\psi(x, z)]$, where both $\Phi(x) = \max_{y\in\mathcal Y}\phi(x, y)$ and $\Psi(x)=\max_{z\in\mathcal Z}\psi(x, z)$ are weakly convex functions, and $\phi(…

Cited by 1SourcePDFScholar
2023

Generalized-Smooth Nonconvex Optimization is As Efficient As Smooth Nonconvex Optimization

ICML 2023poster

Various optimal gradient-based algorithms have been developed for smooth nonconvex optimization. However, many nonconvex machine learning problems do not belong to the class of smooth functions and therefore the existing algorithms are sub-optimal. Instead, these problems have been shown to satisfy…