AVIN-Chat: An Audio-Visual Interactive Chatbot System with Emotional State Tuning
Chanhyuk Park, Jungbin Cho, Junwan Kim, Seongmin Lee, Jungsu Kim, Sanghoon Lee
Abstract
This work presents an audio-visual interactive chatbot (AVIN-Chat) system that allows users to have face-to-face conversations with 3D avatars in real-time. Compared to the previous chatbot services, which provide text-only or speech-only communications, the proposed AVIN-Chat can offer audio-visual communications providing users with a superior experience quality. In addition, the proposed AVIN-Chat emotionally speaks and expresses according to the user's emotional state. Thus, it enables users to establish a strong bond with the chatbot system, increasing the user's immersion. Through user subjective tests, it is demonstrated that the proposed system provides users with a higher sense of immersion than previous chatbot systems. The demonstration video is available at https://www.youtube.com/watch?v=Z74uIV9k7_k.
BibTeX
@inproceedings{ijcai2024p1027,
title = {AVIN-Chat: An Audio-Visual Interactive Chatbot System with Emotional State Tuning},
author = {Park, Chanhyuk and Cho, Jungbin and Kim, Junwan and Lee, Seongmin and Kim, Jungsu and Lee, Sanghoon},
booktitle = {Proceedings of the Thirty-Third International Joint Conference on
Artificial Intelligence, {IJCAI-24}},
publisher = {International Joint Conferences on Artificial Intelligence Organization},
editor = {Kate Larson},
pages = {8763--8766},
year = {2024},
month = {8},
note = {Demo Track},
doi = {10.24963/ijcai.2024/1027},
url = {https://doi.org/10.24963/ijcai.2024/1027},
}