Yaraslau Ivashynka

Tilting the Odds at the Lottery: the Interplay of Overparameterisation and Curricula in Neural Networks

A wide range of empirical and theoretical works have shown that overparameterisation can amplify the performance of neural networks. According to the lottery ticket hypothesis, overparameterised networks have an increased chance of containing a sub-network that is well-initialised to solve the task…