Nataša Jovanović

(1D) Ordered Tokens Enable Efficient Test-Time Search

Tokenization is a key component of autoregressive generative models, converting raw data into more manageable units for modeling. Commonly, tokens describe local information, such as regions of pixels in images or word pieces in text, and autoregressive generation commonly predicts these tokens in a…