2023
Boosting Prompt-Based Few-Shot Learners Through Out-of-Domain Knowledge Distillation
ICASSP 2023accepted
Prompt-based learning improves the performance of Pre-trained Language Models (PLMs) over few-shot learning and is suitable for low-resourced scenarios. However, it is challenging to deploy large PLMs online. Knowledge Distillation (KD) can compress large PLMs into small ones; yet, few-shot KD for p…