2026
LiMuon: Light and Fast Muon Optimizer for Large Models
ICML 2026poster
Large models recently are widely applied in machine learning, so efficient training of large models has received widespread attention. More recently, a useful Muon optimizer is specifically designed for matrix-structured parameters of large models. Although some works have begun to studying the Muon…