Improving the Detection of Multilingual Online Attacks with Rich Social Media Data from Singapore
Janosch Haber, Bertie Vidgen, Matthew Chapman, Vibhor Agarwal, Roy Ka-Wei Lee, Yong Keong Yap, Paul Röttger
Abstract
Toxic content is a global problem, but most resources for detecting toxic content are in English. When datasets are created in other languages, they often focus exclusively on one language or dialect. In many cultural and geographical settings, however, it is common to code-mix languages, combining and interchanging them throughout conversations. To shine a light on this practice, and enable more research into code-mixed toxic content, we introduce SOA, a new multilingual dataset of online attacks. Using the multilingual city-state of Singapore as a starting point, we collect a large corpus of Reddit comments in Indonesian, Malay, Singlish, and other languages, and provide fine-grained hierarchical labels for online attacks. We publish the corpus with rich metadata, as well as additional unlabelled data for domain adaptation. We share comprehensive baseline results, show how the metadata can be used for granular error analysis, and demonstrate the benefits of domain adaptation for detecting multilingual online attacks.
BibTeX
@inproceedings{haber-etal-2023-improving,
title = "Improving the Detection of Multilingual Online Attacks with Rich Social Media Data from {S}ingapore",
author = {Haber, Janosch and
Vidgen, Bertie and
Chapman, Matthew and
Agarwal, Vibhor and
Lee, Roy Ka-Wei and
Yap, Yong Keong and
R{\"o}ttger, Paul},
editor = "Rogers, Anna and
Boyd-Graber, Jordan and
Okazaki, Naoaki",
booktitle = "Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)",
month = jul,
year = "2023",
address = "Toronto, Canada",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2023.acl-long.711/",
doi = "10.18653/v1/2023.acl-long.711",
pages = "12705--12721"
}