Shuyin Ouyang

DSCodeBench: A Realistic Benchmark for Data Science Code Generation

We introduce DSCodeBench, a new benchmark designed to evaluate large language models (LLMs) on complicated and realistic data science code generation tasks. DSCodeBench consists of 1,000 carefully constructed problems sourced from realistic problems from GitHub across ten widely used Python data sci