Renaud Vandeghen*

Efficient Image Pre-Training with Siamese Cropped Masked Autoencoders

"Self-supervised pre-training of image encoders is omnipresent in the literature, particularly following the introduction of Masked autoencoders (MAE). Current efforts attempt to learn object-centric representations from motion in videos. In particular, SiamMAE recently introduced a Siamese network,…