2025
Exploring the Hidden Capacity of LLMs for One-Step Text Generation
EMNLP 2025
A recent study showed that large language models (LLMs) can reconstruct surprisingly long texts — up to thousands of tokens — via autoregressive generation from just one trained input embedding. In this work, we explore whether autoregressive decoding is essential for such reconstruction. We show th