David Persson

The Polar Express: Optimal Matrix Sign Methods and their Application to the Muon Algorithm

Computing the polar decomposition and the related matrix sign function has been a well-studied problem in numerical analysis for decades. Recently, it has emerged as an important subroutine within the Muon algorithm for training deep neural networks. However, the requirements of this application di…