2026
StochasTok: Improving Fine-Grained Subword Understanding in LLMs
ICLR 2026poster
Subword-level understanding is integral to numerous tasks, including understanding multi-digit numbers, spelling mistakes, abbreviations, rhyming, and wordplay. Despite this, current large language models (LLMs) still struggle disproportionally with seemingly simple subword-level tasks, like countin…