2026
Dual Perspectives on Non-Contrastive Self-Supervised Learning
ICLR 2026poster
The {\em stop gradient} and {\em exponential moving average} iterative procedures are commonly used in non-contrastive approaches to self-supervised learning to avoid representation collapse, with excellent performance in downstream applications in practice. This presentation investigates these proc…