Neural Collapse-Informed Initialization with Perturbation Injection in Classification-based Metric Learning
Recent studies have revealed Neural Collapse (NC) in deep classifiers, where last-layer weights and features align into an equiangular tight frame (ETF), concentrating class information along specific embedding directions. However, conventional fine-tuning typically disregards this structure, initi