← Search

King Han

2 accepted papers

2025

LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code

ICLR 2025poster

Large Language Models (LLMs) applied to code-related applications have emerged as a prominent field, attracting significant interest from academia and industry. However, as new and improved LLMs are developed, existing evaluation benchmarks (e.g., HumanEvla, MBPP) are no longer sufficient for assess…

Cited by 224SourcePDFScholar
2024

R2E: Turning any Github Repository into a Programming Agent Environment

ICML 2024poster

While Large Language Models’ (LLMs) coding capabilities have advanced rapidly, corresponding evaluation benchmarks on real-world programming setups are yet to catch up. Building a scalable and interactive testbed for evaluating general-purpose AI coding agents for real-world code has been challengin…

Cited by 26SourcePDFScholar