Contrastive Learning Relies More on Spatial Inductive Bias Than Supervised Learning: An Empirical Study
Though self-supervised contrastive learning (CL) has shown its potential to achieve state-of-the-art accuracy without any supervision, its behavior still remains under investigated by academia. Different from most previous work that understands CL from learning objectives, we focus on an unexplored…