2024
Double Variance Reduction: A Smoothing Trick for Composite Optimization Problems without First-Order Gradient
ICML 2024spotlight
Variance reduction techniques are designed to decrease the sampling variance, thereby accelerating convergence rates of first-order (FO) and zeroth-order (ZO) optimization methods. However, in composite optimization problems, ZO methods encounter an additional variance called the coordinate-wise var…