Hoang-Chau Luong

Fundamental Convergence Analysis of Sharpness-Aware Minimization

The paper investigates the fundamental convergence properties of Sharpness-Aware Minimization (SAM), a recently proposed gradient-based optimization method (Foret et al., 2021) that significantly improves the generalization of deep neural networks. The convergence properties including the stationari…