2025
AlgoTune: Can Language Models Speed Up General-Purpose Numerical Programs?
NeurIPS 2025poster
Despite progress in language model (LM) capabilities, evaluations have thus far focused on models' performance on tasks that humans have previously solved, including in programming (SWE-Bench) and mathematics (FrontierMath). We therefore propose testing models' ability to design and implement algor…