2026
Lions and Muons: Optimization via Stochastic Frank-Wolfe
ICML 2026poster
Stochastic Frank-Wolfe is a classical optimization method for solving constrained optimization problems. On the other hand, recent optimizers such as Lion and Muon have gained quite significant popularity in deep learning. In this work, building on recent initiatives, we provide a unifying perspecti…