Difficult Examples Hurt Unsupervised Contrastive Learning: A Theoretical Perspective
Unsupervised contrastive learning has shown significant performance improvements in recent years, often approaching or even rivaling supervised learning in various tasks. However, its learning mechanism is fundamentally different from supervised learning. Previous works have shown that difficult exa…