← Search

Beatrice Savoldi

9 accepted papers

2026

MCIF: Multimodal Crosslingual Instruction-Following Benchmark from Scientific Talks

ICLR 2026poster

Recent advances in large language models have laid the foundation for multimodal LLMs (MLLMs), which unify text, speech, and vision within a single framework. As these models are rapidly evolving toward general-purpose instruction following across diverse and complex tasks, a key frontier is evaluat…

Cited by 0SourcecodeScholar
2025

Mind the Inclusivity Gap: Multilingual Gender-Neutral Translation Evaluation with mGeNTE

EMNLP 2025

Avoiding the propagation of undue (binary) gender inferences and default masculine language remains a key challenge towards inclusive multilingual technologies, particularly when translating into languages with extensive gendered morphology. Gender-neutral translation (GNT) represents a linguistic s

Cited by 0SourcePDFScholar
2025

SHADES: Towards a Multilingual Assessment of Stereotypes in Large Language Models

NAACL 2025long

Large Language Models (LLMs) reproduce and exacerbate the social biases present in their training data, and resources to quantify this issue are limited. While research has attempted to identify and mitigate such biases, most efforts have been concentrated around English, lagging the rapid advanceme…

Cited by 1SourcePDFScholar
2025

Translation in the Hands of Many: Centering Lay Users in Machine Translation Interactions

EMNLP 2025

Converging societal and technical factors have transformed language technologies into user-facing applications used by the general public across languages. Machine Translation (MT) has become a global tool, with cross-lingual services now also supported by dialogue systems powered by multilingual La

Cited by 0SourcePDFScholar
2024

Twists, Humps, and Pebbles: Multilingual Speech Recognition Models Exhibit Gender Performance Gaps

EMNLP 2024main

Current automatic speech recognition (ASR) models are designed to be used across many languages and tasks without substantial changes. However, this broad language coverage hides performance gaps within languages, for example, across genders. Our study systematically evaluates the performance of two…

2024

What the Harm? Quantifying the Tangible Impact of Gender Bias in Machine Translation with a Human-centered Study

EMNLP 2024main

Gender bias in machine translation (MT) is recognized as an issue that can harm people and society. And yet, advancements in the field rarely involve people, the final MT users, or inform how they might be impacted by biased technologies. Current evaluations are often restricted to automatic methods…

2023

Hi Guys or Hi Folks? Benchmarking Gender-Neutral Machine Translation with the GeNTE Corpus

EMNLP 2023long main

Gender inequality is embedded in our communication practices and perpetuated in translation technologies. This becomes particularly apparent when translating into grammatical gender languages, where machine translation (MT) often defaults to masculine and stereotypical representations by making undu…

Cited by 0SourcecodeScholar
2022

Under the Morphosyntactic Lens: A Multifaceted Evaluation of Gender Bias in Speech Translation

ACL 2022long

Gender bias is largely recognized as a problematic phenomenon affecting language technologies, with recent studies underscoring that it might surface differently across languages. However, most of current evaluation practices adopt a word-level focus on a narrow set of occupational nouns under synth…

2020

Breeding Gender-aware Direct Speech Translation Systems

COLING 2020main

In automatic speech translation (ST), traditional cascade approaches involving separate transcription and translation steps are giving ground to increasingly competitive and more robust direct solutions. In particular, by translating speech audio data without intermediate transcription, direct ST mo…

Cited by 23SourcePDFScholar