Zhanwang Zhang — accepted AI-conference papers

2024

ReSyncer: Rewiring Style-based Generator for Unified Audio-Visually Synced Facial Performer

Jiazhi Guan*, Zhiliang Xu, Hang Zhou, Kaisiyuan Wang, Shengyi He, Zhanwang Zhang +7

ECCV 2024oral

"Lip-syncing videos with given audio is the foundation for various applications including the creation of virtual presenters or performers. While recent studies explore high-fidelity lip-sync with different techniques, their task-orientated models either require long-term videos for clip-specific tr…

Cited by 4 Source ↗PDF ↗Scholar ↗

2023

StyleSync: High-Fidelity Generalized and Personalized Lip Sync in Style-Based Generator

Jiazhi Guan, Zhanwang Zhang, Hang Zhou, Tianshu Hu, Kaisiyuan Wang, Dongliang He +5

CVPR 2023poster

Despite recent advances in syncing lip movements with any audio waves, current methods still struggle to balance generation quality and the model's generalization ability. Previous studies either require long-term data for training or produce a similar movement pattern on all subjects with low quali…

Cited by 71 Source ↗PDF ↗Scholar ↗