← Search

Xingkang He

3 accepted papers

2022

Revisit last-iterate convergence of mSGD under milder requirement on step size

NeurIPS 2022accept

Understanding convergence of SGD-based optimization algorithms can help deal with enormous machine learning problems. To ensure last-iterate convergence of SGD and momentum-based SGD (mSGD), the existing studies usually constrain the step size $\epsilon_{n}$ to decay as $\sum_{n=1}^{+\infty}\ep…

Cited by 6SourcePDFScholar