Miguel Ruiz-Garcia

Tilting the playing field: Dynamical loss functions for machine learning

We show that learning can be improved by using loss functions that evolve cyclically during training to emphasize one class at a time. In underparameterized networks, such dynamical loss functions can lead to successful training for networks that fail to find deep minima of the standard cross-entrop…