2026
Hard Labels In! Rethinking the Role of Hard Labels in Mitigating Local Semantic Drift
ICML 2026poster
Soft labels from teacher models are a $\textit{de facto}$ practice for knowledge transfer and large-scale dataset distillation (e.g., SRe$^2$L, RDED, LPLD). However, when we limit the number of crops per image to reduce the substantial cost of storing precomputed soft labels, these methods suffer se…