← Search

Akankshya Mishra

2 accepted papers

2025

Is the Top Still Spinning? Evaluating Subjectivity in Narrative Understanding

EMNLP 2025

Determining faithfulness of a claim to a source document is an important problem across many domains. This task is generally treated as a binary judgment of whether the claim is supported or unsupported in relation to the source. In many cases, though, whether a claim is supported can be ambiguous.

2024

STORYSUMM: Evaluating Faithfulness in Story Summarization

EMNLP 2024main

Human evaluation has been the gold standard for checking faithfulness in abstractive summarization. However, with a challenging source domain like narrative, multiple annotators can agree a summary is faithful, while missing details that are obvious errors only once pointed out. We therefore introdu…