Nicolas Berkouk

Singular Value Representation: A New Graph Perspective On Neural Networks

We introduce the Singular Value Representation (SVR), a new method to represent the internal state of neural networks using SVD factorization of the weights. This construction yields a new weighted graph connecting what we call spectral neurons, that correspond to specific activation patterns of cla…