Haoyang Ling

NPHardEval: Dynamic Benchmark on Reasoning Ability of Large Language Models via Complexity Classes

Complex reasoning ability is one of the most important features of Large Language Models (LLMs). Numerous benchmarks have been established to assess the reasoning abilities of LLMs. However, they are inadequate in offering a rigorous evaluation and prone to the risk of overfitting, as these publicly…