2026
Implicit Bias of Per-sample Adam on Separable Data: Departure from the Full-batch Regime
ICLR 2026poster
Adam [Kingma & Ba, 2015] is the de facto optimizer in deep learning, yet its theoretical understanding remains limited. Prior analyses show that Adam favors solutions aligned with $\ell_\infty$-geometry, but these results are restricted to the full-batch regime. In this work, we study the implicit b…