← Search

Alex Aiken

9 accepted papers

2025

EquiBench: Benchmarking Large Language Models’ Reasoning about Program Semantics via Equivalence Checking

EMNLP 2025

As large language models (LLMs) become integral to code-related tasks, a central question emerges: Do LLMs truly understand program semantics? We introduce EquiBench, a new benchmark for evaluating LLMs through equivalence checking, i.e., determining whether two programs produce identical outputs fo

2025

Improving Parallel Program Performance with LLM Optimizers via Agent-System Interfaces

ICML 2025poster

Modern scientific discovery increasingly relies on high-performance computing for complex modeling and simulation. A key challenge in improving parallel program performance is efficiently mapping tasks to processors and data to memory, a process dictated by intricate, low-level system code known as…

Cited by 0SourcePDFScholar
2025

SATBench: Benchmarking LLMs’ Logical Reasoning via Automated Puzzle Generation from SAT Formulas

EMNLP 2025

We introduce SATBench, a benchmark for evaluating the logical reasoning capabilities of large language models (LLMs) through logical puzzles derived from Boolean satisfiability (SAT) problems.Unlike prior work that focuses on inference rule-based reasoning, which often involves deducing conclusions

2023

On the Correctness of Automatic Differentiation for Neural Networks with Machine-Representable Parameters

ICML 2023poster

Recent work has shown that forward- and reverse- mode automatic differentiation (AD) over the reals is almost always correct in a mathematically precise sense. However, actual programs work with machine-representable numbers (e.g., floating-point numbers), not reals. In this paper, we study the corr…

Cited by 6SourcePDFScholar
2023

Putting People in Their Place: Affordance-Aware Human Insertion Into Scenes

CVPR 2023poster

We study the problem of inferring scene affordances by presenting a method for realistically inserting people into scenes. Given a scene image with a marked region and an image of a person, we insert the person into the scene while respecting the scene affordances. Our model can infer the set of rea…

2019

SPoC: Search-based Pseudocode to Code

NeurIPS 2019poster

We consider the task of mapping pseudocode to executable code, assuming a one-to-one correspondence between lines of pseudocode and lines of code. Given test cases as a mechanism to validate programs, we search over the space of possible translations of the pseudocode to find a program that compiles…

Cited by 256SourcePDFScholar
2018

Exploring Hidden Dimensions in Accelerating Convolutional Neural Networks

ICML 2018oral

The past few years have witnessed growth in the computational requirements for training deep convolutional neural networks. Current approaches parallelize training onto multiple devices by applying a single parallelization strategy (e.g., data or model parallelism) to all layers in a network. Althou…

Cited by 54SourcePDFScholar