Charles Ide

SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?

We present SWE-Bench Pro, a comprehensive benchmark designed to evaluate software engineering capabilities through complex, realistic programming challenges. This benchmark extends beyond traditional algorithmic problems to encompass the full spectrum of professional software development tasks. The …