2022
Knowledge Transfer from Large-Scale Pretrained Language Models to End-To-End Speech Recognizers
ICASSP 2022accepted
End-to-end speech recognition is a promising technology for enabling compact automatic speech recognition (ASR) systems since it can unify the acoustic and language model into a single neural network. However, as a drawback, training of end-to-end speech recognizers always requires transcribed utter…