Jeffrey Ma — accepted AI-conference papers

2026

QuArch: A Benchmark for Evaluating LLM Reasoning in Computer Architecture

Shvetank Prakash, Andrew Cheng, Arya Tschand, Mark Mazumder, Varun Gohil, Jeffrey Ma +21

ICML 2026poster

The field of computer architecture, which bridges high-level software abstractions and low-level hardware implementations, remains absent from current large language model (LLM) evaluations. To this end, we present QuArch (pronounced 'quark'), the first benchmark designed to facilitate the developme…

Cited by 0 Source ↗Scholar ↗

2026

SWE-fficiency: Can Language Models Optimize Real-World Repositories on Real Workloads?

Jeffrey Ma, Milad Hashemi, Amir Yazdanbakhsh, Kevin Swersky, Ofir Press, Enhui Li +2

ICML 2026poster

Optimizing the performance of large-scale software repositories demands expertise in code reasoning and software engineering (SWE) to reduce runtime while preserving program correctness. However, most benchmarks emphasize what to fix rather than how to fix code. We introduce SWE-fficiency, a benchma…

Cited by 0 Source ↗Scholar ↗