← Search

Renato Geh

2 accepted papers

2024

Where is the signal in tokenization space?

EMNLP 2024main

Large Language Models (LLMs) are typically shipped with tokenizers that *deterministically* encode text into so-called *canonical* token sequences, to which the LLMs assign probability values.One common assumption is that the probability of a piece of text is the probability of its canonical token s…

Cited by 3SourcePDFScholar