← Search

Runyan Yang

2 accepted papers

2021

Pre-Training Transformer Decoder for End-to-End ASR Model with Unpaired Text Data

ICASSP 2021accepted

This paper presents a method to pre-train transformer-based encoder-decoder automatic speech recognition (ASR) models using sufficient target-domain text. During pre-training, we train the transformer decoder as a conditional language model with empty or artifical states, rather than the real encode…

Cited by 0SourceScholar