← Search

Rahul Sharma

5 accepted papers

2025

RE-IMAGINE: Symbolic Benchmark Synthesis for Reasoning Evaluation

ICML 2025poster

Recent Large Language Models (LLMs) have reported high accuracy on reasoning benchmarks. However, it is still unclear whether the observed results arise from true “reasoning” or from statistical recall of the training set. Inspired by the ladder of causation (Pearl, 2009) and its three levels (assoc…

Cited by 0SourcePDFScholar
2025

X-Hacking: The Threat of Misguided AutoML

ICML 2025poster

Explainable AI (XAI) and interpretable machine learning methods help to build trust in model predictions and derived insights, yet also present a perverse incentive for analysts to manipulate XAI metrics to support pre-specified conclusions. This paper introduces the concept of X-hacking, a form of…

2023

Ranking LLM-Generated Loop Invariants for Program Verification

EMNLP 2023short findings

Synthesizing inductive loop invariants is fundamental to automating program verification. In this work we observe that Large Language Models (such as {gpt-3.5} or {gpt-4}) are capable of synthesizing loop invariants for a class of programs in a 0-shot setting, yet require several samples to generate…

Cited by 0SourcecodeScholar
2022

Federated Learning with Noisy User Feedback

NAACL 2022long

Machine Learning (ML) systems are getting increasingly popular, and drive more and more applications and services in our daily life. Thishas led to growing concerns over user privacy, since human interaction data typically needs to be transmitted to the cloud in order to trainand improve such system…

Cited by 14SourcePDFScholar
2020

Vocal Tract Articulatory Contour Detection in Real-Time Magnetic Resonance Images Using Spatio-Temporal Context

ICASSP 2020accepted

Due to its ability to visualize and measure the dynamics of vocal tract shaping during speech production, real-time magnetic resonance imaging (rtMRI) has emerged as one of the prominent research tools. The ability to track different articulators such as the tongue, lips, velum, and the pharynx is a…

Cited by 0SourceScholar