2025
Exact risk curves of signSGD in High-Dimensions: quantifying preconditioning and noise-compression effects
ICML 2025poster
In recent years, SignSGD has garnered interest as both a practical optimizer as well as a simple model to understand adaptive optimizers like Adam. Though there is a general consensus that SignSGD acts to precondition optimization and reshapes noise, quantitatively understanding these effects in the…