← Search

Luciana Benotti

8 accepted papers

2025

HESEIA: A community-based dataset for evaluating social biases in large language models, co-designed in real school settings in Latin America

EMNLP 2025

Most resources for evaluating social biases in Large Language Models are developed without co-design from the communities affected by these biases, and rarely involve participatory approaches. We introduce HESEIA, a dataset of 46,499 sentences created in a professional development course. The course

Cited by 0SourcePDFScholar
2024

CVQA: Culturally-diverse Multilingual Visual Question Answering Benchmark

NeurIPS 2024oral

Visual Question Answering~(VQA) is an important task in multimodal AI, which requires models to understand and reason on knowledge present in visual and textual data. However, most of the current VQA datasets and models are primarily focused on English and a few major world languages, with images th…

Cited by 34SourcePDFScholar
2024

Your Stereotypical Mileage May Vary: Practical Challenges of Evaluating Biases in Multiple Languages and Cultural Contexts

COLING 2024main

Warning: This paper contains explicit statements of offensive stereotypes which may be upsetting The study of bias, fairness and social impact in Natural Language Processing (NLP) lacks resources in languages other than English. Our objective is to support the evaluation of bias in language models i…

Cited by 8SourcePDFScholar
2022

What kinds of errors do reference resolution models make and what can we learn from them?

NAACL 2022findings

Referring resolution is the task of identifying the referent of a natural language expression, for example “the woman behind the other woman getting a massage”. In this paper we investigate which are the kinds of referring expressions on which current transformer based models fail. Motivated by this…

Cited by 2SourcePDFScholar
2021

Region under Discussion for visual dialog

EMNLP 2021main

Visual Dialog is assumed to require the dialog history to generate correct responses during a dialog. However, it is not clear from previous work how dialog history is needed for visual dialog. In this paper we define what it means for a visual question to require dialog history and we release a sub…