Dohwan Kim

DISPATCH: DISTILLING SELECTIVE PATCHES FOR SPEECH ENHANCEMENT

In speech enhancement, knowledge distillation (KD) compresses models by transferring a high-capacity teacher's knowledge to a compact student. However, conventional KD methods train the student to mimic the teacher's output entirely, which forces the student to imitate the regions where the teacher…