Multimodal Extraction and Recognition of Arabic Implicit Discourse Relations
Ahmed Ruby, Christian Hardmeier, Sara Stymne
Abstract
Most research on implicit discourse relation identification has focused on written language, however, it is also crucial to understand these relations in spoken discourse. We introduce a novel method for implicit discourse relation identification across both text and speech, that allows us to extract examples of semantically equivalent pairs of implicit and explicit discourse markers, based on aligning speech+transcripts with subtitles in another language variant. We apply our method to Egyptian Arabic, resulting in a novel high-quality dataset of spoken implicit discourse relations. We present a comprehensive approach to modeling implicit discourse relation classification using audio and text data with a range of different models. We find that text-based models outperform audio-based models, but combining text and audio features can lead to enhanced performance.
BibTeX
@inproceedings{ruby-etal-2025-multimodal,
title = "Multimodal Extraction and Recognition of {A}rabic Implicit Discourse Relations",
author = "Ruby, Ahmed and
Hardmeier, Christian and
Stymne, Sara",
editor = "Rambow, Owen and
Wanner, Leo and
Apidianaki, Marianna and
Al-Khalifa, Hend and
Eugenio, Barbara Di and
Schockaert, Steven",
booktitle = "Proceedings of the 31st International Conference on Computational Linguistics",
month = jan,
year = "2025",
address = "Abu Dhabi, UAE",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2025.coling-main.363/",
pages = "5415--5429"
}