← Search

Nam Trung Pham

2 accepted papers

2026

Condensed Data Expansion Using Model Inversion for Knowledge Distillation

AAAI 2026technical

Condensed datasets offer a compact representation of larger datasets, but training models directly on them or using them to enhance model performance through knowledge distillation (KD) can result in suboptimal outcomes due to limited information. To address this, we propose a method that expands co

Cited by 0SourcePDFScholar
2022

Robust and Resource-Efficient Data-Free Knowledge Distillation by Generative Pseudo Replay

AAAI 2022technical

Data-Free Knowledge Distillation (KD) allows knowledge transfer from a trained neural network (teacher) to a more compact one (student) in the absence of original training data. Existing works use a validation set to monitor the accuracy of the student over real data and report the highest performan…