2025
EquiBench: Benchmarking Large Language Models’ Reasoning about Program Semantics via Equivalence Checking
EMNLP 2025
As large language models (LLMs) become integral to code-related tasks, a central question emerges: Do LLMs truly understand program semantics? We introduce EquiBench, a new benchmark for evaluating LLMs through equivalence checking, i.e., determining whether two programs produce identical outputs fo