← Search

Qiming Zhu

2 accepted papers

2025

DOMAINEVAL: An Auto-Constructed Benchmark for Multi-Domain Code Generation

AAAI 2025technical

Code benchmarks such as HumanEval are widely adopted to evaluate the capabilities of Large Language Models (LLMs), providing insights into their strengths and weaknesses. However, current benchmarks primarily exercise LLMs' capability on common coding tasks (e.g., bubble sort, greatest common diviso…

Cited by 4SourcePDFScholar
2024

Executing Natural Language-Described Algorithms with Large Language Models: An Investigation

COLING 2024main

Executing computer programs described in natural language has long been a pursuit of computer science. With the advent of enhanced natural language understanding capabilities exhibited by large language models (LLMs), the path toward this goal has been illuminated. In this paper, we seek to examine…