Sandesh Swamy

Searching for Optimal Solutions with LLMs via Bayesian Optimization

Scaling test-time compute to search for optimal solutions is an important step towards building generally-capable language models that can reason. Recent work, however, shows that tasks of varying complexity require distinct search strategies to solve optimally, thus making it challenging to design…