Andrew Tremante

SpotIt: Evaluating Text-to-SQL Evaluation with Formal Verification

Community-driven Text-to-SQL evaluation platforms play a pivotal role in tracking the state of the art of Text-to-SQL performance. The reliability of the evaluation process is critical for driving progress in the field. Current evaluation methods are largely test-based, which involves comparing the…