Towards Speech Dialogue Translation Mediating Speakers of Different Languages

Shuichiro Shimizu; Chenhui Chu; Sheng Li; Sadao Kurohashi

ACL 2023findings0 citations

Towards Speech Dialogue Translation Mediating Speakers of Different Languages

Shuichiro Shimizu, Chenhui Chu, Sheng Li, Sadao Kurohashi

Abstract

We present a new task, speech dialogue translation mediating speakers of different languages. We construct the SpeechBSD dataset for the task and conduct baseline experiments. Furthermore, we consider context to be an important aspect that needs to be addressed in this task and propose two ways of utilizing context, namely monolingual context and bilingual context. We conduct cascaded speech translation experiments using Whisper and mBART, and show that bilingual context performs better in our settings.

BibTeX

@inproceedings{shimizu-etal-2023-towards,
    title = "Towards Speech Dialogue Translation Mediating Speakers of Different Languages",
    author = "Shimizu, Shuichiro  and
      Chu, Chenhui  and
      Li, Sheng  and
      Kurohashi, Sadao",
    editor = "Rogers, Anna  and
      Boyd-Graber, Jordan  and
      Okazaki, Naoaki",
    booktitle = "Findings of the Association for Computational Linguistics: ACL 2023",
    month = jul,
    year = "2023",
    address = "Toronto, Canada",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2023.findings-acl.72/",
    doi = "10.18653/v1/2023.findings-acl.72",
    pages = "1122--1134"
}