Sjoerd Steenkiste — accepted AI-conference papers

2024

A Systematic Comparison of Syllogistic Reasoning in Humans and Language Models

Tiwalayo Eisape, Michael Tessler, Ishita Dasgupta, Fei Sha, Sjoerd Steenkiste, Tal Linzen

NAACL 2024long

A central component of rational behavior is logical inference: the process of determining which conclusions follow from a set of premises. Psychologists have documented several ways in which humans’ inferences deviate from the rules of logic. Do language models, which are trained on text generated b…

Cited by 20 Source ↗PDF ↗code ↗Scholar ↗

2024

The Impact of Depth on Compositional Generalization in Transformer Language Models

Jackson Petty, Sjoerd Steenkiste, Ishita Dasgupta, Fei Sha, Dan Garrette, Tal Linzen

NAACL 2024long

To process novel sentences, language models (LMs) must generalize compositionally—combine familiar elements in new ways. What aspects of a model’s structure promote compositional generalization? Focusing on transformers, we test the hypothesis, motivated by theoretical and empirical work, that deepe…

Cited by 10 Source ↗PDF ↗Scholar ↗