2026
One Step Forward and K Steps Back: Better Reasoning with Denoising Recursion Models
ICML 2026poster
Looped transformers scale computational depth independent of parameter count by repeatedly applying the same layer. However, training these models over long horizons creates significant optimization challenges. Specifically, it is difficult for looped transformers that start from noise to steer towa…