2026
FutureFill: Fast Generation from Convolutional Sequence Models
ICLR 2026poster
We address the challenge of efficient auto-regressive generation in sequence prediction models by introducing FutureFill—a general-purpose fast generation method for any sequence prediction algorithm based on convolutional operators. FutureFill reduces generation time from quadratic to quasilinear i…