2025
First-Step Advantage: Importance of Starting Right in Multi-Step Math Reasoning
ACL 2025finding
Language models can solve complex reasoning tasks better by learning to generate rationales for their predictions. Often these models know how to solve a task but their auto-regressive decoding nature leads to incorrect results if started incorrectly. We observe that smaller models in particular, wh…