Xiaonan Zhao

Visual Representation Learning with Self-Supervised Attention for Low-Label High-Data Regime

Self-supervision has shown outstanding results for natural language processing, and more recently, for image recognition. Simultaneously, vision transformers and its variants have emerged as a promising and scalable alternative to convolutions on various computer vision tasks. In this paper, we are…