Magdalena Markowska — accepted AI-conference papers

2024

Views Are My Own, but Also Yours: Benchmarking Theory of Mind Using Common Ground

Adil Soubki, John Murzaku, Arash Yousefi Jordehi, Peter Zeng, Magdalena Markowska, Seyed Abolghasem Mirroshandel +1

ACL 2024findings

Evaluating the theory of mind (ToM) capabilities of language models (LMs) has recently received a great deal of attention. However, many existing benchmarks rely on synthetic data, which risks misaligning the resulting experiments with human behavior. We introduce the first ToM dataset based on natu…

Cited by 4 Source ↗PDF ↗code ↗Scholar ↗

2023

Finding Common Ground: Annotating and Predicting Common Ground in Spoken Conversations

Magdalena Markowska, Mohammad Taghizadeh, Adil Soubki, Seyed Abolghasem Mirroshandel, Owen Rambow

EMNLP 2023long findings

When we communicate with other humans, we do not simply generate a sequence of words. Rather, we use our cognitive state (beliefs, desires, intentions) and our model of the audience’s cognitive state to create utterances that affect the audience’s cognitive state in the intended manner. An important…

Cited by 0 Source ↗code ↗Scholar ↗

2022

Re-Examining FactBank: Predicting the Author’s Presentation of Factuality

John Murzaku, Peter Zeng, Magdalena Markowska, Owen Rambow

COLING 2022main

We present a corrected version of a subset of the FactBank data set. Previously published results on FactBank are no longer valid. We perform experiments on FactBank using multiple training paradigms, data smoothing techniques, and polarity classifiers. We argue that f-measure is an important altern…

Cited by 10 Source ↗PDF ↗Scholar ↗