2024
Iteration Head: A Mechanistic Study of Chain-of-Thought
NeurIPS 2024poster
Chain-of-Thought (CoT) reasoning is known to improve Large Language Models both empirically and in terms of theoretical approximation power. However, our understanding of the inner workings and conditions of apparition of CoT capabilities remains limited. This paper helps fill this gap by demonstrat…