Vincent-Daniel Yun

SHARPNESS-AWARE MINIMIZATION WITH Z-SCORE GRADIENT FILTERING

Deep neural networks achieve high performance across many domains but can still face challenges in generalization when optimization is influenced by small or noisy gradient components. Sharpness-Aware Minimization improves generalization by perturbing parameters toward directions of high curvature,…