← Search

Sumit Agarwal

3 accepted papers

2023

CodeBERTScore: Evaluating Code Generation with Pretrained Models of Code

EMNLP 2023long main

Since the rise of neural natural-language-to-code models (NL$\rightarrow$Code) that can generate long expressions and statements rather than a single next-token, one of the major problems has been reliably evaluating their generated output. In this paper, we propose CodeBERTScore: an evaluation met…

Cited by 0SourcecodeScholar
2022

PRO-CS : An Instance-Based Prompt Composition Technique for Code-Switched Tasks

EMNLP 2022main

Code-switched (CS) data is ubiquitous in today’s globalized world, but the dearth of annotated datasets in code-switching poses a significant challenge for learning diverse tasks across different language pairs. Parameter-efficient prompt-tuning approaches conditioned on frozen language models have…