Jake A. Levinson

A Random Matrix Perspective on Mixtures of Nonlinearities in High Dimensions

One of the distinguishing characteristics of modern deep learning systems is their use of neural network architectures with enormous numbers of parameters, often in the millions and sometimes even in the billions. While this paradigm has inspired significant research on the properties of large netwo…