David Teh-Hwa Kao

Robust and Unbounded Length Generalization in Autoregressive Transformer-Based Text-to-Speech

Autoregressive (AR) Transformer-based sequence models are known to have difficulty generalizing to sequences longer than those seen during training. When applied to text-to-speech (TTS), these models tend to drop or repeat words or produce erratic output, especially for longer utterances. In this pa…