2026
Muon Outperforms Adam in Tail-End Associative Memory Learning
ICLR 2026poster
The Muon optimizer is consistently faster than Adam in training Large Language Models (LLMs), yet the mechanism underlying its success remains unclear. This paper demystifies this mechanism through the lens of associative memory. By ablating the transformer components optimized by Muon, we reveal th…