← Search

Peter Kirgis

2 accepted papers

2026

Holistic Agent Leaderboard: The Missing Infrastructure for AI Agent Evaluation

ICLR 2026poster

AI agents have been developed for complex real-world tasks from coding to customer service. But AI agent evaluations suffer from many challenges that undermine our understanding of how well agents really work (Figure 1). We introduce the Holistic Agent Leaderboard (HAL) to address these challenges.…

Cited by 0SourcecodeScholar
2026

Towards a Science of AI Agent Reliability

ICML 2026poster

AI agents are increasingly deployed for consequential tasks. Yet existing benchmarks evaluate only task success rates, ignoring whether agents behave consistently, remain robust to perturbations, fail predictably, or bound error severity. We propose a framework for measuring agent reliability ground…

Cited by 0SourceScholar