Yash Salunkhe

Directional Neural Collapse for Self-Supervised Visual Representation Learning

Frozen self-supervised representations often transfer well with only a few labels across many semantic tasks. We argue that a single geometric quantity, *directional* CDNV (decision-axis variance), sits at the core of two favorable behaviors: strong few-shot transfer within a task, and low interfere…