← Search

Rohan Surana

4 accepted papers

2026

Importance Sampling for Multi-Negative Multimodal Direct Preference Optimization

ICLR 2026poster

Direct Preference Optimization (DPO) has recently been extended from text-only models to vision-language models. However, existing methods rely on oversimplified pairwise comparisons, generating a single negative image via basic perturbations or similarity-based retrieval, which fail to capture the…

Cited by 0SourceScholar
2026

WS-GRPO: Weakly-Supervised Group-Relative Policy Optimization for Rollout-Efficient Reasoning

ICML 2026poster

Group Relative Policy Optimization (GRPO) is effective for training language models on complex reasoning. However, since the objective is defined relative to a group of sampled trajectories, extended deliberation can create more chances to realize relative gains, leading to inefficient reasoning and…

Cited by 0SourceScholar
2025

Image Difference Captioning via Adversarial Preference Optimization

EMNLP 2025

Image Difference Captioning (IDC) aims to generate natural language descriptions that highlight subtle differences between two visually similar images. While recent advances leverage pre-trained vision-language models to align fine-grained visual differences with textual semantics, existing supervis

Cited by 0SourcePDFScholar