← Search

Luca Buratti

3 accepted papers

2024

Beyond Accuracy: Evaluating Self-Consistency of Code Large Language Models with IdentityChain

ICLR 2024poster

Code Large Language Models (Code LLMs) are being increasingly employed in real-life applications, so evaluating them is critical. While the conventional accuracy evaluates the performance of Code LLMs on a set of individual tasks, their self-consistency across different tasks is overlooked. Intuitiv…

2022

Towards Learning (Dis)-Similarity of Source Code from Program Contrasts

ACL 2022long

Understanding the functional (dis)-similarity of source code is significant for code modeling tasks such as software vulnerability and code clone detection. We present DISCO (DIS-similarity of COde), a novel self-supervised model focusing on identifying (dis)similar functionalities of source code. D…

Cited by 40SourcePDFScholar
2021

CodeNet: A Large-Scale AI for Code Dataset for Learning a Diversity of Coding Tasks

NeurIPS 2021poster

Over the last several decades, software has been woven into the fabric of every aspect of our society. As software development surges and code infrastructure of enterprise applications ages, it is now more critical than ever to increase software development productivity and modernize legacy applicat…

Cited by 327SourcecodeScholar