← Search

Carolin Holtermann

9 accepted papers

2025

Around the World in 24 Hours: Probing LLM Knowledge of Time and Place

ACL 2025long

Reasoning over time and space is essential for understanding our world. However, the abilities of language models in this area are largely unexplored as previous work has tested their abilities for logical reasoning in terms of time and space in isolation or only in simple or artificial environments…

2025

Centurio: On Drivers of Multilingual Ability of Large Vision-Language Model

ACL 2025long

Most Large Vision-Language Models (LVLMs) to date are trained predominantly on English data, which makes them struggle to understand non-English input and fail to generate output in the desired target language. Existing efforts mitigate these issues by adding multilingual training data, but do so in…

Cited by 0SourcePDFScholar
2025

GIMMICK: Globally Inclusive Multimodal Multitask Cultural Knowledge Benchmarking

ACL 2025finding

Large Vision-Language Models (LVLMs) have recently gained attention due to their distinctive performance and broad applicability. While it has been previously shown that their efficacy in usage scenarios involving non-Western contexts falls short, existing studies are limited in scope, covering just…

2025

Large Language Models Discriminate Against Speakers of German Dialects

EMNLP 2025

Dialects represent a significant component of human culture and are found across all regions of the world. In Germany, more than 40% of the population speaks a regional dialect (Adler and Hansen, 2022). However, despite cultural importance, individuals speaking dialects often face negative societal

Cited by 0SourcePDFScholar
2025

SHADES: Towards a Multilingual Assessment of Stereotypes in Large Language Models

NAACL 2025long

Large Language Models (LLMs) reproduce and exacerbate the social biases present in their training data, and resources to quantify this issue are limited. While research has attempted to identify and mitigate such biases, most efforts have been concentrated around English, lagging the rapid advanceme…

Cited by 1SourcePDFScholar
2024

Evaluating the Elementary Multilingual Capabilities of Large Language Models with MultiQ

ACL 2024findings

Large language models (LLMs) need to serve everyone, including a global majority of non-English speakers. However, most LLMs today, and open LLMs in particular, are often intended for use in just English (e.g. Llama2, Mistral) or a small handful of high-resource languages (e.g. Mixtral, Qwen). Recen…

2024

ScaLearn: Simple and Highly Parameter-Efficient Task Transfer by Learning to Scale

ACL 2024findings

Multi-task learning (MTL) has shown considerable practical benefits, particularly when using language models (LMs). While this is commonly achieved by learning tasks under a joint optimization procedure, some methods, such as AdapterFusion, divide the problem into two stages: (i) task learning, wher…

2024

Why do LLaVA Vision-Language Models Reply to Images in English?

EMNLP 2024finding

We uncover a surprising multilingual bias occurring in a popular class of multimodal vision-language models (VLMs). Including an image in the query to a LLaVA-style VLM significantly increases the likelihood of the model returning an English response, regardless of the language of the query. This pa…

Cited by 4SourcePDFScholar
2022

Fair and Argumentative Language Modeling for Computational Argumentation

ACL 2022long

Although much work in NLP has focused on measuring and mitigating stereotypical bias in semantic spaces, research addressing bias in computational argumentation is still in its infancy. In this paper, we address this research gap and conduct a thorough investigation of bias in argumentative language…