2026
EditBench: Evaluating LLM Abilities to Perform Real-World Instructed Code Edits
ICLR 2026oral
Instructed code editing, where LLMs directly modify a developer's existing code based on a user instruction, is becoming a widely used interaction mode in AI coding assistants. However, few benchmarks directly evaluate this capability and current datasets often rely on artificial sources. We introdu…