AAAI 2023technical1 citations
Music-to-Facial Expressions: Emotion-Based Music Visualization for the Hearing Impaired
Yubo Wang, Fengzhou Pan, Danni Liu, Jiaxiong Hu
Abstract
While music is made to convey messages and emotions, auditory music is not equally accessible to everyone. Music visualization is a common approach to augment the listening experiences of the hearing users and to provide music experiences for the hearing-impaired. In this paper, we present a music visualization system that can turn the input of a piece of music into a series of facial expressions representative of the continuously changing sentiments in the music. The resulting facial expressions, recorded as action units, can later animate a static virtual avatar to be emotive synchronously with the music.
BibTeX
@article{Wang_Pan_Liu_Hu_2024, title={Music-to-Facial Expressions: Emotion-Based Music Visualization for the Hearing Impaired}, volume={37}, url={https://ojs.aaai.org/index.php/AAAI/article/view/26912}, DOI={10.1609/aaai.v37i13.26912}, abstractNote={While music is made to convey messages and emotions, auditory music is not equally accessible to everyone. Music visualization is a common approach to augment the listening experiences of the hearing users and to provide music experiences for the hearing-impaired. In this paper, we present a music visualization system that can turn the input of a piece of music into a series of facial expressions representative of the continuously changing sentiments in the music. The resulting facial expressions, recorded as action units, can later animate a static virtual avatar to be emotive synchronously with the music.}, number={13}, journal={Proceedings of the AAAI Conference on Artificial Intelligence}, author={Wang, Yubo and Pan, Fengzhou and Liu, Danni and Hu, Jiaxiong}, year={2024}, month={Jul.}, pages={16096-16102} }