Kunjie Ren

A Parameter-Free and Near-Optimal Zeroth-Order Algorithm for Stochastic Convex Optimization

This paper studies zeroth-order optimization for stochastic convex minimization problems. We propose a parameter-free stochastic zeroth-order method (POEM), which introduces a step-size scheme based on the distance over finite difference and an adaptive smoothing parameter. Our theoretical analysis…