A Speech-driven Sign Language Avatar Animation System for Hearing Impaired Applications
Li Hu, Jiahui Li, Jiashuo Zhang, Qi Wang, Bang Zhang, Ping Tan
Abstract
Sign language is the communication language used in hearing impaired community. Recently, the research of sign language production has made great progress but still need to cope with some critical challenges. In this paper, we propose a system-level scheme and push forward the implementation of sign language production for practical usage. We build a system capable of translating speech into sign language avatar. Different from previous approach only focusing on single technology, we systematically combine algorithms of language translation, body gesture animation and facial avatar generation. We also develop two applications: Sign Language Interpretation APP and Virtual Sign Language Anchor, to facilitate easy and clear communication for hearing impaired people.
BibTeX
@inproceedings{ijcai2022p852,
title = {A Speech-driven Sign Language Avatar Animation System for Hearing Impaired Applications},
author = {Hu, Li and Li, Jiahui and Zhang, Jiashuo and Wang, Qi and Zhang, Bang and Tan, Ping},
booktitle = {Proceedings of the Thirty-First International Joint Conference on
Artificial Intelligence, {IJCAI-22}},
publisher = {International Joint Conferences on Artificial Intelligence Organization},
editor = {Lud De Raedt},
pages = {5912--5915},
year = {2022},
month = {7},
note = {Demo Track},
doi = {10.24963/ijcai.2022/852},
url = {https://doi.org/10.24963/ijcai.2022/852},
}