Molly Feldman

StudentEval: A Benchmark of Student-Written Prompts for Large Language Models of Code

Code LLMs have the potential to make it easier for non-experts to understand and write code. However, current CodeLLM benchmarks rely on a single expert-written prompt per problem, making it hard to generalize their success to non-expert users. In this paper, we present a new natural-language-to-cod…