← Search

William Song

2 accepted papers

2025

Planning in Natural Language Improves LLM Search for Code Generation

ICLR 2025spotlight

While scaling training compute has led to remarkable improvements in large language models (LLMs), scaling inference compute only recently began to yield analogous gains. We hypothesize that a core missing component is a lack of diverse LLM outputs, leading to inefficient search due to models repeat…

2024

A Careful Examination of Large Language Model Performance on Grade School Arithmetic

NeurIPS 2024spotlight

Large language models (LLMs) have achieved impressive success on many benchmarks for mathematical reasoning. However, there is growing concern that some of this performance actually reflects dataset contamination, where data closely resembling benchmark questions leaks into the training data, instea…

Cited by 77SourcePDFScholar