← Search

Tim O’Gorman

5 accepted papers

2024

Every Answer Matters: Evaluating Commonsense with Probabilistic Measures

ACL 2024long

Large language models have demonstrated impressive performance on commonsense tasks; however, these tasks are often posed as multiple-choice questions, allowing models to exploit systematic biases. Commonsense is also inherently probabilistic with multiple correct answers. The purpose of “boiling wa…

2022

DISAPERE: A Dataset for Discourse Structure in Peer Review Discussions

NAACL 2022long

At the foundation of scientific evaluation is the labor-intensive process of peer review. This critical task requires participants to consume vast amounts of highly technical text. Prior work has annotated different aspects of review argumentation, but discourse relations between reviews and rebutta…

Cited by 27SourcePDFScholar
2022

DocAMR: Multi-Sentence AMR Representation and Evaluation

NAACL 2022long

Despite extensive research on parsing of English sentences into Abstract Meaning Representation (AMR) graphs, which are compared to gold graphs via the Smatch metric, full-document parsing into a unified graph representation lacks well-defined representation and evaluation. Taking advantage of a sup…

2021

Improved Latent Tree Induction with Distant Supervision via Span Constraints

EMNLP 2021main

For over thirty years, researchers have developed and analyzed methods for latent tree induction as an approach for unsupervised syntactic parsing. Nonetheless, modern systems still do not perform well enough compared to their supervised counterparts to have any practical use as structural annotatio…

2021

MS-Mentions: Consistently Annotating Entity Mentions in Materials Science Procedural Text

EMNLP 2021main

Material science synthesis procedures are a promising domain for scientific NLP, as proper modeling of these recipes could provide insight into new ways of creating materials. However, a fundamental challenge in building information extraction models for material science synthesis procedures is gett…

Cited by 8SourcePDFScholar