2024
LipVoicer: Generating Speech from Silent Videos Guided by Lip Reading
ICLR 2024poster
Lip-to-speech involves generating a natural-sounding speech synchronized with a soundless video of a person talking. Despite recent advances, current methods still cannot produce high-quality speech with high levels of intelligibility for challenging and realistic datasets such as LRS3. In this work…