2026
InstructDubber: Instruction-based Alignment for Zero-shot Movie Dubbing
AAAI 2026technical
Movie dubbing seeks to synthesize speech from a given script using a specific voice, while ensuring accurate lip synchronization and emotion-prosody alignment with the character’s visual performance. However, existing alignment approaches based on visual features face two key limitations: (1) they r