2026
Importance Sampling for Multi-Negative Multimodal Direct Preference Optimization
ICLR 2026poster
Direct Preference Optimization (DPO) has recently been extended from text-only models to vision-language models. However, existing methods rely on oversimplified pairwise comparisons, generating a single negative image via basic perturbations or similarity-based retrieval, which fail to capture the…