← Search

Artem Riabinin

2 accepted papers

2026

From Muon to Gluon: Bridging Theory and Practice of LMO-based Optimizers for LLMs

ICML 2026poster

Recent developments in deep learning optimization have brought about radically new algorithms based on the Linear Minimization Oracle (LMO) framework, such as Muon and Scion. After over a decade of Adam's dominance, these LMO-based methods are emerging as viable replacements, offering several practi…

Cited by 0SourceScholar
2025

Error Feedback under $(L_0,L_1)$-Smoothness: Normalization and Momentum

NeurIPS 2025poster

We provide the first proof of convergence for normalized error feedback algorithms across a wide range of machine learning problems. Despite their popularity and efficiency in training deep neural networks, traditional analyses of error feedback algorithms rely on the smoothness assumption that doe…

Cited by 0SourceScholar