← Search

Stéphane Ayache

2 accepted papers

2024

Implicit Regularization in Deep Tucker Factorization: Low-Rankness via Structured Sparsity

AISTATS 2024poster

We theoretically analyze the implicit regularization of deep learning for tensor completion. We show that deep Tucker factorization trained by gradient descent induces a structured sparse regularization. This leads to a characterization of the effect of the depth of the neural network on the implici…

Cited by 1SourcePDFScholar
2022

Are Vision-Language Transformers Learning Multimodal Representations? A Probing Perspective

AAAI 2022technical

In recent years, joint text-image embeddings have significantly improved thanks to the development of transformer-based Vision-Language models. Despite these advances, we still need to better understand the representations produced by those models. In this paper, we compare pre-trained and fine-tune…