← Search

Ian Pratt-Hartmann

5 accepted papers

2025

Unravelling the Logic: Investigating the Generalisation of Transformers in Numerical Satisfiability Problems

ACL 2025long

Transformer models have achieved remarkable performance in many formal reasoning tasks. Nonetheless, the extent of their comprehension pertaining to logical semantics and rules of inference remains somewhat uncertain. Evaluating such understanding necessitates a rigorous examination of these models’…

Cited by 0SourcePDFScholar
2024

Graph-Induced Syntactic-Semantic Spaces in Transformer-Based Variational AutoEncoders

NAACL 2024findings

The injection of syntactic information in Variational AutoEncoders (VAEs) can result in an overall improvement of performances and generalisation. An effective strategy to achieve such a goal is to separate the encoding of distributional semantic features and syntactic structures into heterogeneous…

2024

Natural Language Satisfiability: Exploring the Problem Distribution and Evaluating Transformer-based Language Models

ACL 2024long

Efforts to apply transformer-based language models (TLMs) to the problem of reasoning in natural language have enjoyed ever-increasing success in recent years. The most fundamental task in this area to which nearly all others can be reduced is that of determining satisfiability. However, from a logi…

Cited by 2SourcePDFScholar
2023

Not all quantifiers are equal: Probing Transformer-based language models' understanding of generalised quantifiers

EMNLP 2023long main

How do different generalised quantifiers affect the behaviour of transformer-based language models (TLMs)? The recent popularity of TLMs and the central role generalised quantifiers have traditionally played in linguistics and logic bring this question into particular focus. The current research inv…

Cited by 0SourceScholar
2022

Can Transformers Reason in Fragments of Natural Language?

EMNLP 2022main

State-of-the-art deep-learning-based approaches to Natural Language Processing (NLP) are credited with various capabilities that involve reasoning with natural language texts. %However, reasoning in this setting is often ill-defined and shallow. In this paper we carry out a large-scale empirical stu…