Chunghsin YEH*

Masked Generative Video-to-Audio Transformers with Enhanced Synchronicity

"Video-to-audio (V2A) generation leverages visual-only video features to render plausible sounds that match the scene. Importantly, the generated sound onsets should match the visual actions that are aligned with them, otherwise unnatural synchronization artifacts arise. Recent works have explored t…