Iordan Ganev

Symmetries, Flat Minima, and the Conserved Quantities of Gradient Flow

Empirical studies of the loss landscape of deep networks have revealed that many local minima are connected through low-loss valleys. Yet, little is known about the theoretical origin of such valleys. We present a general framework for finding continuous symmetries in the parameter space, which carv…