2026
Rectified Decoupled Dataset Distillation: A Closer Look for Fair and Comprehensive Evaluation
ICLR 2026poster
Dataset distillation aims to generate compact synthetic datasets that enable models trained on them to achieve performance comparable to those trained on full real datasets, while substantially reducing storage and computational costs. Early bi-level optimization methods (e.g., MTT) have shown promi…