← Search

Joseph Lilien

2 accepted papers

2023

Dr.Spider: A Diagnostic Evaluation Benchmark towards Text-to-SQL Robustness

ICLR 2023top-5%

Neural text-to-SQL models have achieved remarkable performance in translating natural language questions into SQL queries. However, recent studies reveal that text-to-SQL models are vulnerable to task-specific perturbations. Previous curated robustness test sets usually focus on individual phenomena…

Cited by 22SourcePDFScholar
2023

Importance of Synthesizing High-quality Data for Text-to-SQL Parsing

ACL 2023findings

There has been increasing interest in synthesizing data to improve downstream text-to-SQL tasks. In this paper, we examined the existing synthesized datasets and discovered that state-of-the-art text-to-SQL algorithms did not further improve on popular benchmarks when trained with augmented syntheti…