← Search

Chris Reed

9 accepted papers

2025

Lexical Recall or Logical Reasoning: Probing the Limits of Reasoning Abilities in Large Language Models

ACL 2025long

Despite the increasing interest in the reasoning abilities of Large Language Models (LLMs), existing work shows limitations in assessing logic abilities independently from lexical memory. We address this gap with Mystery-Zebra. This robust two-part benchmark (4,290 puzzles) challenges the logic abst…

2025

Looking at the Unseen: Effective Sampling of Non-Related Propositions for Argument Mining

COLING 2025main

Traditionally, argument mining research has approached the task of automatic identification of argument structures by using existing definitions of what constitutes an argument, while leaving the equally important matter of what does not qualify as an argument unaddressed. With the ability to distin…

Cited by 0SourcePDFScholar
2025

Natural Language Reasoning in Large Language Models: Analysis and Evaluation

ACL 2025finding

While Large Language Models (LLMs) have demonstrated promising results on a range of reasoning benchmarks—particularly in formal logic, mathematical tasks, and Chain-of-Thought prompting—less is known about their capabilities in unconstrained natural language reasoning. Argumentative reasoning, a fo…

2024

External Knowledge-Driven Argument Mining: Leveraging Attention-Enhanced Multi-Network Models

EMNLP 2024main

Argument mining (AM) involves the identification of argument relations (AR) between Argumentative Discourse Units (ADUs). The essence of ARs among ADUs is context-dependent and lies in maintaining a coherent flow of ideas, often centered around the relations between discussed entities, topics, theme…

Cited by 0SourcePDFScholar
2024

FORECAST2023: A Forecast and Reasoning Corpus of Argumentation Structures

COLING 2024main

It is known from large-scale crowd experimentation that some people are innately better at analysing complex situations and making justified predictions – the so-called ‘superforecasters’. Surprisingly, however, there has to date been no work exploring the role played by the reasoning in those justi…

Cited by 0SourcePDFScholar
2021

Knowledge-Enhanced Evidence Retrieval for Counterargument Generation

EMNLP 2021finding

Finding counterevidence to statements is key to many tasks, including counterargument generation. We build a system that, given a statement, retrieves counterevidence from diverse sources on the Web. At the core of this system is a natural language inference (NLI) model that determines whether a can…