Ekaterina Grishina*

Tight and Efficient Upper Bound on Spectral Norm of Convolutional Layers

"Controlling the spectral norm of the Jacobian matrix, which is related to the convolution operation, has been shown to improve generalization, training stability and robustness in CNNs. Existing methods for computing the norm either tend to overestimate it or their performance may deteriorate quick…