Jim Maar

What's the plan? Metrics for implicit planning in LLMs and their application to rhyme generation

Prior work suggests that language models, while trained on next token prediction, show implicit planning behavior: they may select the next token in preparation to a predicted future token, such as a likely rhyming word, as supported by a prior qualitative study of Claude 3.5 Haiku using a cross-lay…