Kais Hariz — accepted AI-conference papers

2024

Implicit Regularization in Deep Tucker Factorization: Low-Rankness via Structured Sparsity

Kais Hariz, Hachem Kadri, Stéphane Ayache, Maher Moakher, Thierry Artières

AISTATS 2024poster

We theoretically analyze the implicit regularization of deep learning for tensor completion. We show that deep Tucker factorization trained by gradient descent induces a structured sparse regularization. This leads to a characterization of the effect of the depth of the neural network on the implici…

Cited by 1 Source ↗PDF ↗Scholar ↗

2022

Implicit Regularization with Polynomial Growth in Deep Tensor Factorization

Kais Hariz, Hachem Kadri, Stephane Ayache, Maher Moakher, Thierry Artieres

ICML 2022spotlight

We study the implicit regularization effects of deep learning in tensor factorization. While implicit regularization in deep matrix and ’shallow’ tensor factorization via linear and certain type of non-linear neural networks promotes low-rank solutions with at most quadratic growth, we show that its…

Cited by 5 Source ↗PDF ↗Scholar ↗