2026
The Implicit Bias of Depth: From Neural Collapse to Softmax Codes
ICML 2026poster
Neural collapse (NC) describes the structured geometry that emerges in the features and weights of trained classifiers. Recent theory suggests NC can be suboptimal in deep architectures, attributing this to an explicit low-rank bias from L2 regularization. We study the deep unconstrained feature mod…