2022
Implicit Regularization in Hierarchical Tensor Factorization and Deep Convolutional Neural Networks
ICML 2022spotlight
In the pursuit of explaining implicit regularization in deep learning, prominent focus was given to matrix and tensor factorizations, which correspond to simplified neural networks. It was shown that these models exhibit an implicit tendency towards low matrix and tensor ranks, respectively. Drawing…