2024
Learning with Unmasked Tokens Drives Stronger Vision Learners
ECCV 2024poster
"Masked image modeling (MIM) has become a leading self-supervised learning strategy. MIMs such as Masked Autoencoder (MAE) learn strong representations by randomly masking input tokens for the encoder to process, with the decoder reconstructing the masked tokens to the input. However, MIM pre-traine…