Ammar Sherif

DELT: A Simple Diversity-driven EarlyLate Training for Dataset Distillation

Recent advances in dataset distillation have led to solutions in two main directions. The conventional batch-to-batch matching mechanism is ideal for small-scale datasets and includes bi-level optimization methods on models and syntheses, such as FRePo, RCIG, and RaT-BPTT, as well as other methods l…