Sean O{'}Brien — accepted AI-conference papers

2025

EnDive: A Cross-Dialect Benchmark for Fairness and Performance in Large Language Models

Abhay Gupta, Jacob Cheung, Philip Meng, Shayan Sayyed, Kevin Zhu, Austen Liao +1

EMNLP 2025

The diversity of human language, shaped by social, cultural, and regional influences, presents significant challenges for natural language processing (NLP) systems. Existing benchmarks often overlook intra-language variations, leaving speakers of non-standard dialects underserved. To address this ga

Cited by 0 Source ↗PDF ↗Scholar ↗

2025

NovelHopQA: Diagnosing Multi-Hop Reasoning Failures in Long Narrative Contexts

Abhay Gupta, Kevin Zhu, Vasu Sharma, Sean O{'}Brien, Michael Lu

EMNLP 2025

Current large language models (LLMs) struggle to answer questions that span tens of thousands of tokens, especially when multi-hop reasoning is involved. While prior benchmarks explore long-context comprehension or multi-hop reasoning in isolation, none jointly vary context length and reasoning dept

Cited by 0 Source ↗PDF ↗code ↗Scholar ↗