Wenzhao Xiang

Wavelet-Driven Masked Image Modeling: A Path to Efficient Visual Representation

Masked Image Modeling (MIM) has garnered significant attention in self-supervised learning, thanks to its impressive capacity to learn scalable visual representations tailored for downstream tasks. However, images inherently contain abundant redundant information, leading the pixel-based MIM reconst…