← Search

Hugh James Leather

4 accepted papers

2024

CRUXEval: A Benchmark for Code Reasoning, Understanding and Execution

ICML 2024poster

We present Code Reasoning, Understanding, and eXecution Evaluation, a benchmark consisting of 800 Python functions (3-13 lines). Each function comes with an input-output pair, leading to two natural tasks: input prediction and output prediction. First, we propose a general recipe for generating our…

Cited by 84SourcePDFScholar
2023

CoLLAT: On Adding Fine-grained Audio Understanding to Language Models using Token-Level Locked-Language Tuning

NeurIPS 2023poster

Humans can easily understand various audio concepts, but conventional audio classification models fail due to their inability to predict unseen classes during training. To address this challenge, recent literature has explored contrastive language-audio pretraining to learn an audio understanding mo…

Cited by 6SourcePDFScholar
2023

Code Translation with Compiler Representations

ICLR 2023top-25%

In this paper, we leverage low-level compiler intermediate representations (IR) code translation. Traditional transpilers rely on syntactic information and handcrafted rules, which limits their applicability and produces unnatural-looking code. Applying neural machine translation (NMT) approaches to…

Cited by 86SourcePDFScholar
2023

Learning Compiler Pass Orders using Coreset and Normalized Value Prediction

ICML 2023poster

Finding the optimal pass sequence of compilation can lead to a significant reduction in program size. Prior works on compilation pass ordering have two major drawbacks. They either require an excessive budget (in terms of the number of compilation passes) at compile time or fail to generalize to uns…