2026
Mitigating The Distribution Shift of Diffusion-based Dataset Distillation
CVPR 2026
Dataset Distillation (DD) seeks to create small, synthetic datasets for efficient model training. While diffusion models are powerful generators, their use in DD is hampered by distribution shifts between synthetic and ideal distilled data, leading to suboptimal performance. We identify two critical