Rectified Decoupled Dataset Distillation: A Closer Look for Fair and Comprehensive Evaluation
Dataset distillation aims to generate compact synthetic datasets that enable models trained on them to achieve performance comparable to those trained on full real datasets, while substantially reducing storage and computational costs. Early bi-level optimization methods (e.g., MTT) have shown promi…