2024
Reasoning or a Semblance of it? A Diagnostic Study of Transitive Reasoning in LLMs
EMNLP 2024main
Evaluating Large Language Models (LLMs) on reasoning benchmarks demonstrates their ability to solve compositional questions. However, little is known of whether these models engage in genuine logical reasoning or simply rely on implicit cues to generate answers. In this paper, we investigate the tra…