Shana Kleiner — accepted AI-conference papers

2025

Data Caricatures: On the Representation of African American Language in Pretraining Corpora

Nicholas Deas, Blake Vente, Amith Ananthram, Jessica A Grieser, Desmond U. Patton, Shana Kleiner +2

ACL 2025long

With a combination of quantitative experiments, human judgments, and qualitative analyses, we evaluate the quantity and quality of African American Language (AAL) representation in 12 predominantly English, open-source pretraining corpora. We specifically focus on the sources, variation, and natural…

Cited by 0 Source ↗PDF ↗Scholar ↗

2023

Evaluation of African American Language Bias in Natural Language Generation

Nicholas Deas, Jessica A Grieser, Shana Kleiner, Desmond U. Patton, Elsbeth Turcan, Kathleen McKeown

EMNLP 2023long main

While biases disadvantaging African American Language (AAL) have been uncovered in models for tasks such as speech recognition and toxicity detection, there has been little investigation of these biases for language generation models like ChatGPT. We evaluate how well LLMs understand AAL in comparis…

Cited by 0 Source ↗Scholar ↗