AAAI 2026technical0 citations
FinMathBench: A Formula-Driven Benchmark for Evaluating LLMs’ Math Reasoning Capabilities in Finance
Yi He, Ping Wang, Shiqiang Xiong, Chao Chen, Haixiang Hu
Abstract
Many existing financial math reasoning benchmarks suffer from data contamination and high manual construction costs. To address this, we propose a novel formula-driven approach to dynamically construct math reasoning benchmarks in finance. Our two-stage approach: (1) generates single-formula questions by LLMs using a "Mask-for-Solve" paradigm for ground truth answers, and (2) synthesizes multi-formula questions through hierarchical tree-based DAGs. Our approach ensures novelty (via LLMs
BibTeX
@inproceedings{aaai2026_finmathbenchafor,
title = {FinMathBench: A Formula-Driven Benchmark for Evaluating LLMs’ Math Reasoning Capabilities in Finance},
author = {Yi He and Ping Wang and Shiqiang Xiong and Chao Chen and Haixiang Hu},
booktitle = {AAAI 2026},
year = {2026}
}