← Search

Bhargava Kumar

4 accepted papers

2025

Conformal Prediction Sets Can Cause Disparate Impact

ICLR 2025spotlight

Conformal prediction is a statistically rigorous method for quantifying uncertainty in models by having them output sets of predictions, with larger sets indicating more uncertainty. However, prediction sets are not inherently actionable; many applications require a single output to act on, not seve…

2025

MVTamperBench: Evaluating Robustness of Vision-Language Models

ACL 2025finding

Multimodal Large Language Models (MLLMs), are recent advancement of Vision-Language Models (VLMs) that have driven major advances in video understanding. However, their vulnerability to adversarial tampering and manipulations remains underexplored. To address this gap, we introduce MVTamperBench, a…

2025

SweEval: Do LLMs Really Swear? A Safety Benchmark for Testing Limits for Enterprise Use

NAACL 2025industry

Enterprise customers are increasingly adopting Large Language Models (LLMs) for critical communication tasks, such as drafting emails, crafting sales pitches, and composing casual messages. Deploying such models across different regions requires them to understand diverse cultural and linguistic con…

2024

Conformal Prediction Sets Improve Human Decision Making

ICML 2024poster

In response to everyday queries, humans explicitly signal uncertainty and offer alternative answers when they are unsure. Machine learning models that output calibrated prediction sets through conformal prediction mimic this human behaviour; larger sets signal greater uncertainty while providing alt…