Improving Robustness of Diffusion-Based Zero-Shot Speech Synthesis via Stable Formant Generation
Diffusion models have achieved remarkable success in text-to-speech (TTS), even in zero-shot scenarios. Recent efforts aim to address the trade-off between inference speed and sound quality, often considered the primary drawback of diffusion models. However, we find a critical mispronunciation issue…