← Search

Stephanie Brandl

7 accepted papers

2024

Evaluating Webcam-based Gaze Data as an Alternative for Human Rationale Annotations

COLING 2024main

Rationales in the form of manually annotated input spans usually serve as ground truth when evaluating explainability methods in NLP. They are, however, time-consuming and often biased by the annotation process. In this paper, we debate whether human gaze, in the form of webcam-based eye-tracking re…

2024

Llama meets EU: Investigating the European political spectrum through the lens of LLMs

NAACL 2024short

Instruction-finetuned Large Language Models inherit clear political leanings that have been shown to influence downstream task performance. We expand this line of research beyond the two-party system in the US and audit Llama Chat in the context of EU politics in various settings to analyze the mode…

2023

Evaluating Bias and Fairness in Gender-Neutral Pretrained Vision-and-Language Models

EMNLP 2023long main

Pretrained machine learning models are known to perpetuate and even amplify existing biases in data, which can result in unfair outcomes that ultimately impact user experience. Therefore, it is crucial to understand the mechanisms behind those prejudicial biases to ensure that model performance does…

Cited by 0SourcecodeScholar
2023

Rather a Nurse than a Physician - Contrastive Explanations under Investigation

EMNLP 2023long main

Contrastive explanations, where one decision is explained *in contrast to another*, are supposed to be closer to how humans explain a decision than non-contrastive explanations, where the decision is not necessarily referenced to an alternative. This claim has never been empirically validated. We an…

Cited by 0SourceScholar
2022

Challenges and Strategies in Cross-Cultural NLP

ACL 2022long

Various efforts in the Natural Language Processing (NLP) community have been made to accommodate linguistic diversity and serve speakers of many different languages. However, it is important to acknowledge that speakers and the content they produce and require, vary not just by language, but also by…

Cited by 58SourcePDFScholar
2022

Do Transformer Models Show Similar Attention Patterns to Task-Specific Human Gaze?

ACL 2022long

Learned self-attention functions in state-of-the-art NLP models often correlate with human attention. We investigate whether self-attention in large-scale pre-trained language models is as predictive of human eye fixation patterns during task-reading as classical cognitive models of human attention.…

2022

How Conservative are Language Models? Adapting to the Introduction of Gender-Neutral Pronouns

NAACL 2022long

Gender-neutral pronouns have recently been introduced in many languages to a) include non-binary people and b) as a generic singular. Recent results from psycholinguistics suggest that gender-neutral pronouns (in Swedish) are not associated with human processing difficulties. This, we show, is in sh…