2018
Critical initialisation for deep signal propagation in noisy rectifier neural networks
NeurIPS 2018poster
Stochastic regularisation is an important weapon in the arsenal of a deep learning practitioner. However, despite recent theoretical advances, our understanding of how noise influences signal propagation in deep neural networks remains limited. By extending recent work based on mean field theory, we…