2026
SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
ICML 2026poster
We present SWE-Bench Pro, a comprehensive benchmark designed to evaluate software engineering capabilities through complex, realistic programming challenges. This benchmark extends beyond traditional algorithmic problems to encompass the full spectrum of professional software development tasks. The …