Yijin Xu

PRG: Prompt-Based Distillation Without Annotation via Proxy Relational Graph

In this paper, we propose a new distillation method for extracting knowledge from Large Foundation Models (LFM) into lightweight models, introducing a novel supervision mode that does not require manually annotated data. While LFMs exhibit exceptional zero-shot classification abilities across datase…