2025
Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction
ICML 2025oral
We design a suite of minimal algorithmic tasks that are a loose abstraction of _open-ended_ real-world tasks. This allows us to cleanly and controllably quantify the creative limits of the present-day language model. Much like real-world tasks that require a creative, far-sighted leap of thought, ou…