← Search

Adrien Bardes

5 accepted papers

2023

Battle of the Backbones: A Large-Scale Comparison of Pretrained Models across Computer Vision Tasks

NeurIPS 2023poster

Neural network based computer vision systems are typically built on a backbone, a pretrained or randomly initialized feature extractor. Several years ago, the default option was an ImageNet-trained convolutional neural network. However, the recent past has seen the emergence of countless backbones…

2023

On the duality between contrastive and non-contrastive self-supervised learning

ICLR 2023top-5%

Recent approaches in self-supervised learning of image representations can be categorized into different families of methods and, in particular, can be divided into contrastive and non-contrastive approaches. While differences between the two families have been thoroughly discussed to motivate new a…

Cited by 116SourcePDFScholar
2022

VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning

ICLR 2022poster

Recent self-supervised methods for image representation learning maximize the agreement between embedding vectors produced by encoders fed with different views of the same image. The main challenge is to prevent a collapse in which the encoders produce constant or non-informative vectors. We introd…

2021

Learning To Hallucinate Examples From Extrinsic and Intrinsic Supervision

ICCV 2021poster

Learning to hallucinate additional examples has recently been shown as a promising direction to address few-shot learning tasks. This work investigates two important yet overlooked natural supervision signals for guiding the hallucination process -- (i) extrinsic: classifiers trained on hallucinated…

Cited by 8PDFScholar