← Search

Rupak Sarkar

6 accepted papers

2025

Measuring scalar constructs in social science with LLMs

EMNLP 2025

Many constructs that characterize language, like its complexity or emotionality, have a naturally continuous semantic structure; a public speech is not just “simple” or “complex”, but exists on a continuum between extremes. Although large language models (LLMs) are an attractive tool for measuring s

Cited by 0SourcePDFScholar
2025

PairScale: Analyzing Attitude Change with Pairwise Comparisons

NAACL 2025findings

We introduce a text-based framework for measuring attitudes in communities toward issues of interest, going beyond the pro/con/neutral of conventional stance detection to characterize attitudes on a continuous scale using both implicit and explicit evidence in language. The framework exploits LLMs b…

2025

Understanding Common Ground Misalignment in Goal-Oriented Dialog: A Case-Study with Ubuntu Chat Logs

ACL 2025long

While it is commonly accepted that maintaining common ground plays a role in conversational success, little prior research exists connecting conversational grounding to success in task-oriented conversations. We study failures of grounding in the Ubuntu IRC dataset, where participants use text-only…

Cited by 0SourcePDFScholar
2024

Pregnant Questions: The Importance of Pragmatic Awareness in Maternal Health Question Answering

NAACL 2024long

Questions posed by information-seeking users often contain implicit false or potentially harmful assumptions. In a high-risk domain such as maternal and infant health, a question-answering system must recognize these pragmatic constraints and go beyond simply answering user questions, examining them…

2023

Natural Language Decompositions of Implicit Content Enable Better Text Representations

EMNLP 2023long main

When people interpret text, they rely on inferences that go beyond the observed language itself. Inspired by this observation, we introduce a method for the analysis of text that takes implicitly communicated content explicitly into account. We use a large language model to produce sets of propositi…

Cited by 0SourcecodeScholar