← Search

Anne Beyer

3 accepted papers

2025

Using Game Play to Investigate Multimodal and Conversational Grounding in Large Multimodal Models

COLING 2025main

While the situation has improved for text-only models, it again seems to be the case currently that multimodal (text and image) models develop faster than ways to evaluate them. In this paper, we bring a recently developed evaluation paradigm from text models to multimodal models, namely evaluation…

2022

New or Old? Exploring How Pre-Trained Language Models Represent Discourse Entities

COLING 2022main

Recent research shows that pre-trained language models, built to generate text conditioned on some context, learn to encode syntactic knowledge to a certain degree. This has motivated researchers to move beyond the sentence-level and look into their ability to encode less studied discourse-level phe…

2021

Is Incoherence Surprising? Targeted Evaluation of Coherence Prediction from Language Models

NAACL 2021long

Coherent discourse is distinguished from a mere collection of utterances by the satisfaction of a diverse set of constraints, for example choice of expression, logical relation between denoted events, and implicit compatibility with world-knowledge. Do neural language models encode such constraints?…