← Search

Swayam Singh

2 accepted papers

2025

NextCoder: Robust Adaptation of Code LMs to Diverse Code Edits

ICML 2025poster

Software engineering activities frequently involve edits to existing code. However, contemporary code language models (LMs) lack the ability to handle diverse types of code-edit requirements. In this work, we attempt to overcome this shortcoming through (1) a novel synthetic data generation pipeline…

Cited by 0SourcePDFScholar
2024

OctoPack: Instruction Tuning Code Large Language Models

ICLR 2024spotlight

Finetuning large language models (LLMs) on instructions leads to vast performance improvements on natural language tasks. We apply instruction tuning using code, leveraging the natural structure of Git commits, which pair code changes with human instructions. We compile CommitPack: 4 terabytes of Gi…