← Search

Stephanie Winkler

2 accepted papers

2025

WMT24++: Expanding the Language Coverage of WMT24 to 55 Languages & Dialects

ACL 2025finding

As large language models (LLM) become more and more capable in languages other than English, it is important to collect benchmark datasets in order to evaluate their multilingual performance, including on tasks like machine translation (MT). In this work, we extend the WMT24 dataset to cover 55 lang…

Cited by 0SourcePDFScholar
2023

Perception Test: A Diagnostic Benchmark for Multimodal Video Models

NeurIPS 2023poster

We propose a novel multimodal video benchmark - the Perception Test - to evaluate the perception and reasoning skills of pre-trained multimodal models (e.g. Flamingo, BEiT-3, or GPT-4). Compared to existing benchmarks that focus on computational tasks (e.g. classification, detection or tracking), th…