Joeri Lenaerts

Linear CNNs Discover the Statistical Structure of the Dataset Using Only the Most Dominant Frequencies

We here present a stepping stone towards a deeper understanding of convolutional neural networks (CNNs) in the form of a theory of learning in linear CNNs. Through analyzing the gradient descent equations, we discover that the evolution of the network during training is determined by the interplay b…