← Search

Zhongming Yu

4 accepted papers

2026

AMA-Bench: Evaluating Long-Horizon Memory for Agentic Applications

ICML 2026poster

Large Language Models (LLMs) are deployed as autonomous agents in increasingly complex applications, where enabling long horizon memory is critical for achieving strong performance. However, a significant gap exists between practical applications and current evaluation standards for agent memory: ex…

Cited by 0SourceScholar
2026

DevEvol: Benchmarking LLM Agents on Continuous Software Evolution

ICML 2026poster

Large Language Model (LLM) agents have demonstrated remarkable proficiency in solving isolated software engineering tasks. However, existing benchmarks predominantly evaluate static, independent issues, failing to reflect the continuous and sequentially dependent nature of real-world software evolut…

Cited by 0SourceScholar
2026

LLM4Cov: Execution-Grounded Agent Learning for High-Coverage Hardware Verification

ICML 2026poster

Execution-grounded LLM agents offer a promising paradigm for learning from tool feedback, but such feedback is often expensive and slow to obtain, making online reinforcement learning (RL) impractical. High-coverage hardware verification exemplifies this challenge due to its reliance on industrial s…

Cited by 0SourceScholar
2025

OrcaLoca: An LLM Agent Framework for Software Issue Localization

ICML 2025poster

Recent developments in Large Language Model (LLM) agents are revolutionizing Autonomous Software Engineering (ASE), enabling automated coding, problem fixes, and feature improvements. However, localization -- precisely identifying software problems by navigating to relevant code sections -- remains…

Cited by 3SourcePDFScholar