Salma Ziadi

Algorithmic Primitives and Compositional Geometry of Reasoning in Language Models

How do latent and inference time computations enable large language models (LLMs) to solve multi-step reasoning? We introduce a framework for tracing and steering algorithmic primitives that underlie model reasoning. Our approach links reasoning traces to internal activations and evaluates algorithm…