Mun-Hak Lee

Knowledge Distillation from Language Model to Acoustic Model: A Hierarchical Multi-Task Learning Approach

The remarkable performance of the pre-trained language model (LM) using self-supervised learning has led to a major paradigm shift in the study of natural language processing. In line with these changes, leveraging the performance of speech recognition systems with massive deep learning-based LMs is…