EMNLP 2021finding62 citations
fBERT: A Neural Transformer for Identifying Offensive Content
Diptanu Sarkar, Marcos Zampieri, Tharindu Ranasinghe, Alexander Ororbia
Abstract
Transformer-based models such as BERT, XLNET, and XLM-R have achieved state-of-the-art performance across various NLP tasks including the identification of offensive language and hate speech, an important problem in social media. In this paper, we present fBERT, a BERT model retrained on SOLID, the largest English offensive language identification corpus available with over 1.4 million offensive instances. We evaluate fBERT’s performance on identifying offensive content on multiple English datasets and we test several thresholds for selecting instances from SOLID. The fBERT model will be made freely available to the community.
BibTeX
@inproceedings{sarkar-etal-2021-fbert-neural,
title = "f{BERT}: A Neural Transformer for Identifying Offensive Content",
author = "Sarkar, Diptanu and
Zampieri, Marcos and
Ranasinghe, Tharindu and
Ororbia, Alexander",
editor = "Moens, Marie-Francine and
Huang, Xuanjing and
Specia, Lucia and
Yih, Scott Wen-tau",
booktitle = "Findings of the Association for Computational Linguistics: EMNLP 2021",
month = nov,
year = "2021",
address = "Punta Cana, Dominican Republic",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2021.findings-emnlp.154/",
doi = "10.18653/v1/2021.findings-emnlp.154",
pages = "1792--1798"
}