← Search

Mukul Singh

9 accepted papers

2025

An empirical study of validating synthetic data for formula generation

NAACL 2025findings

Large language models (LLMs) can be leveraged to help write formulas in spreadsheets, but formula data resources are scarce, impacting both the base performance of pre-trained models and limiting the ability to fine-tune them. Given a corpus of formulas, we can use another model to generate syntheti…

Cited by 2SourcePDFScholar
2025

Execution-guided within-prompt search for programming-by-example

ICLR 2025poster

Large language models (LLMs) can generate code from examples without being limited to a DSL, but they lack search, as sampled programs are independent. In this paper, we use an LLM as a policy that generates lines of code and then join these lines of code to let the LLM implicitly estimate the value…

Cited by 0SourcePDFScholar
2025

TeCoFeS: Text Column Featurization using Semantic Analysis

NAACL 2025findings

Extracting insights from text columns can bechallenging and time-intensive. Existing methods for topic modeling and feature extractionare based on syntactic features and often overlook the semantics. We introduce the semantictext column featurization problem, and presenta scalable approach for autom…

Cited by 0SourcePDFScholar
2024

EmFORE: Learning Email Folder Classification Rules by Demonstration

AAAI 2024technical

Tools that help with email folder management are limited, as users have to manually write rules to assign emails to folders. We present EMFORE, an iterative learning system that automatically learns and updates such rules from observations. EMFORE is fast enough to suggest and update rules in real t…

Cited by 0SourcePDFScholar
2024

One-to-many testing for code generation from (just) natural language

EMNLP 2024finding

MBPP is a popular dataset for evaluating the task of code generation from natural language. Despite its popularity, there are three problems: (1) it relies on providing test cases to generate the right signature, (2) there is poor alignment between instruction and evaluation test cases, and (3) cont…

2024

RAR: Retrieval-augmented retrieval for code generation in low resource languages

EMNLP 2024main

Language models struggle in generating code for low-resource programming languages, since these are underrepresented in training data. Either examples or documentation are commonly used for improved code generation. We propose to use both types of information together and present retrieval augmented…

2023

CodeFusion: A Pre-trained Diffusion Model for Code Generation

EMNLP 2023short main

Imagine a developer who can only change their last line of code—how often would they have to start writing a function from scratch before it is correct? Auto-regressive models for code generation from natural language have a similar limitation: they do not easily allow reconsidering earlier tokens g…

Cited by 0SourceScholar
2023

InstructExcel: A Benchmark for Natural Language Instruction in Excel

EMNLP 2023long findings

With the evolution of Large Language Models (LLMs) we can solve increasingly more complex NLP tasks across various domains, including spreadsheets. This work investigates whether LLMs can generate code (Excel OfficeScripts, a TypeScript API for executing many tasks in Excel) that solves Excel specif…

Cited by 0SourceScholar
2023

TSTR: Target Similarity Tuning Meets the Real World

EMNLP 2023short findings

Target similarity tuning (TST) is a method of selecting relevant examples in natural language (NL) to code generation through large language models (LLMs) to improve performance. Its goal is to adapt a sentence embedding model to have the similarity between two NL inputs match the similarity between…

Cited by 0SourceScholar