2026
Unpacking the Implicit Norm Dynamics of Sharpness-Aware Minimization in Tensorized Models
AAAI 2026technical
Sharpness-Aware Minimization (SAM) has been proven to be an effective optimization technique for improving generalization in overparameterized models. While prior works have explored the implicit regularization of SAM in simple two-core scale-invariant settings, its behavior in more general tensoriz