Yassine Ouali*

CLIP-DPO: Vision-Language Models as a Source of Preference for Fixing Hallucinations in LVLMs

"Despite recent successes, LVLMs or Large Vision Language Models are prone to hallucinating details like objects and their properties or relations, limiting their real-world deployment. To address this and improve their robustness, we present CLIP-DPO, a preference optimization method that leverages…