Beyond Soft Labels: Unifying Dataset Pruning and Distillation for Efficient Large-scale Compression
Dataset pruning (DP) and dataset distillation (DD) fundamentally differ in their outputs: DP selects original image subsets, while DD generates synthetic images. Recently, DD's increasing reliance on original images suggests a convergence of the two directions. To investigate this convergence trend,…