Shusaku Sone

First Heuristic Then Rational: Dynamic Use of Heuristics in Language Model Reasoning

Explicit multi-step reasoning, such as chain-of-thought, is widely adopted in the community to explore the better performance of language models (LMs). We report on the systematic strategy that LMs use in this process.Our controlled experiments reveal that LMs rely more heavily on heuristics, such a…