2024
PhISANet: Phonetically Informed Speech Animation Network
ICASSP 2024accepted
Realistic animation is crucial for immersive and seamless human-avatar interactions as digital avatars become more prevalent. This work presents PhISANet, an encoder-decoder model that realistically animates the face and tongue solely from speech. PhISANet leverages neural audio representations trai…