← Search

Amit Agarwal

8 accepted papers

2026

Judging What We Cannot Solve: A Consequence-Based Approach for Oracle-Free Evaluation of Research-Level Math

ICML 2026spotlight

Recent progress in reasoning models suggests that generating plausible attempts for research-level mathematics may be within reach, but verification remains a bottleneck, consuming scarce expert time. We hypothesize that a meaningful solution should contain enough method-level information that, when…

Cited by 0SourceScholar
2026

Pushing on Multilingual Reasoning Models with Language-Mixed Chain-of-Thought

ICLR 2026poster

Recent frontier models employ long-chain-of-thought reasoning to explore solution spaces in context and achieve stronger performance. While many works study distillation to build smaller yet capable models, most focus on English and little is known about language-specific reasoning. To bridge this g…

Cited by 0SourcecodeScholar
2026

World in a Frame: Understanding Culture Mixing as a New Challenge for Vision-Language Models

CVPR 2026

In a globalized world, cultural elements from diverse origins frequently appear together within a single visual scene. We refer to these as culture mixing scenarios, yet how Large Vision-Language Models (LVLMs) perceive them remains underexplored. We investigate culture mixing as a critical challeng

Cited by 0SourceScholar
2025

AccessEval: Benchmarking Disability Bias in Large Language Models

EMNLP 2025

Large Language Models (LLMs) are increasingly deployed across diverse domains but often exhibit disparities in how they handle real life queries. To systematically investigate these effects with various disability context, we introduce AccessEval, a large-scale benchmark evaluating total 21 close &

2025

Crowdsource, Crawl, or Generate? Creating SEA-VL, a Multicultural Vision-Language Dataset for Southeast Asia

ACL 2025long

Despite Southeast Asia’s (SEA) extraordinary linguistic and cultural diversity, the region remains significantly underrepresented in vision-language (VL) research, resulting in AI models that inadequately capture SEA cultural nuances. To fill this gap, we present SEA-VL, an open-source initiative de…

2025

FS-DAG: Few Shot Domain Adapting Graph Networks for Visually Rich Document Understanding

COLING 2025industry

In this work, we propose Few Shot Domain Adapting Graph (FS-DAG), a scalable and efficient model architecture for visually rich document understanding (VRDU) in few-shot settings. FS-DAG leverages domain-specific and language/vision specific backbones within a modular framework to adapt to diverse d…

2025

MVTamperBench: Evaluating Robustness of Vision-Language Models

ACL 2025finding

Multimodal Large Language Models (MLLMs), are recent advancement of Vision-Language Models (VLMs) that have driven major advances in video understanding. However, their vulnerability to adversarial tampering and manipulations remains underexplored. To address this gap, we introduce MVTamperBench, a…

2025

SweEval: Do LLMs Really Swear? A Safety Benchmark for Testing Limits for Enterprise Use

NAACL 2025industry

Enterprise customers are increasingly adopting Large Language Models (LLMs) for critical communication tasks, such as drafting emails, crafting sales pitches, and composing casual messages. Deploying such models across different regions requires them to understand diverse cultural and linguistic con…