← Search

James Pustejovsky

14 accepted papers

2025

Beyond Benchmarks: Building a Richer Cross-Document Event Coreference Dataset with Decontextualization

NAACL 2025long

Cross-Document Event Coreference (CDEC) annotation is challenging and difficult to scale, resulting in existing datasets being small and lacking diversity. We introduce a new approach leveraging large language models (LLMs) to decontextualize event mentions, by simplifying the document-level annotat…

Cited by 0SourcePDFScholar
2025

Enhanced Noun-Noun Compound Interpretation through Textual Enrichment

EMNLP 2025

Interpreting Noun-Noun Compounds remains a persistent challenge for Large Language Models (LLMs) because the semantic relation between the modifier and the head is rarely stated explicitly. Recent benchmarks frame Noun-Noun Compound Interpretation as a multiple-choice question. While this setting al

2025

Speech Is Not Enough: Interpreting Nonverbal Indicators of Common Knowledge and Engagement

AAAI 2025technical

Our goal is to develop an AI Partner that can provide support for group problem solving and social dynamics. In multi-party working group environments, multimodal analytics is crucial for identifying non-verbal interactions of group members. In conjunction with their verbal participation, this creat…

Cited by 1SourcePDFScholar
2025

TRACE: Real-Time Multimodal Common Ground Tracking in Situated Collaborative Dialogues

NAACL 2025system demonstrations

We present TRACE, a novel system for live *common ground* tracking in situated collaborative tasks. With a focus on fast, real-time performance, TRACE tracks the speech, actions, gestures, and visual attention of participants, uses these multimodal inputs to determine the set of task-relevant propos…

Cited by 0SourcePDFScholar
2024

Building a Broad Infrastructure for Uniform Meaning Representations

COLING 2024main

This paper reports the first release of the UMR (Uniform Meaning Representation) data set. UMR is a graph-based meaning representation formalism consisting of a sentence-level graph and a document-level graph. The sentence-level graph represents predicate-argument structures, named entities, word se…

Cited by 9SourcePDFScholar
2024

ChainNet: Structured Metaphor and Metonymy in WordNet

COLING 2024main

The senses of a word exhibit rich internal structure. In a typical lexicon, this structure is overlooked: A word’s senses are encoded as a list, without inter-sense relations. We present ChainNet, a lexical resource which for the first time explicitly identifies these structures, by expressing how s…

2024

Common Ground Tracking in Multimodal Dialogue

COLING 2024main

Within Dialogue Modeling research in AI and NLP, considerable attention has been spent on “dialogue state tracking” (DST), which is the ability to update the representations of the speaker’s needs at each turn in the dialogue by taking into account the past dialogue moves and history. Less studied b…

2024

Encoding Gesture in Multimodal Dialogue: Creating a Corpus of Multimodal AMR

COLING 2024main

Abstract Meaning Representation (AMR) is a general-purpose meaning representation that has become popular for its clear structure, ease of annotation and available corpora, and overall expressiveness. While AMR was designed to represent sentence meaning in English text, recent research has explored…

2024

GLAMR: Augmenting AMR with GL-VerbNet Event Structure

COLING 2024main

This paper introduces GLAMR, an Abstract Meaning Representation (AMR) interpretation of Generative Lexicon (GL) semantic components. It includes a structured subeventual interpretation of linguistic predicates, and encoding of the opposition structure of property changes of event arguments. Both of…

2024

Linguistically Conditioned Semantic Textual Similarity

ACL 2024long

Semantic textual similarity (STS) is a fundamental NLP task that measures the semantic similarity between a pair of sentences. In order to reduce the inherent ambiguity posed from the sentences, a recent work called Conditional STS (C-STS) has been proposed to measure the sentences’ similarity condi…

2023

The Coreference under Transformation Labeling Dataset: Entity Tracking in Procedural Texts Using Event Models

ACL 2023findings

We demonstrate that coreference resolution in procedural texts is significantly improved when performing transformation-based entity linking prior to coreference relation identification. When events in the text introduce changes to the state of participating entities, it is often impossible to accur…

2021

COVID-19 Literature Knowledge Graph Construction and Drug Repurposing Report Generation

NAACL 2021system demonstrations

To combat COVID-19, both clinicians and scientists need to digest the vast amount of relevant biomedical knowledge in literature to understand the disease mechanism and the related biological functions. We have developed a novel and comprehensive knowledge discovery framework, COVID-KG to extract fi…