← Search

Zefeng Zhang

4 accepted papers

2025

Debiasing Multimodal Large Language Models via Noise-Aware Preference Optimization

CVPR 2025poster

Multimodal Large Language Models (MLLMs) excel in various tasks, yet often struggle with modality bias, tending to rely heavily on a single modality or prior knowledge when generating responses. In this paper, we propose a debiased preference optimization dataset, RLAIF-V-Bias, and introduce a Noise…

2025

Revealing and Mitigating the Challenge of Detecting Character Knowledge Errors in LLM Role-Playing

EMNLP 2025

Large language model (LLM) role-playing has gained widespread attention. Authentic character knowledge is crucial for constructing realistic LLM role-playing agents. However, existing works usually overlook the exploration of LLMs’ ability to detect characters’ known knowledge errors (KKE) and unkno

2024

Optimal Transport Guided Correlation Assignment for Multimodal Entity Linking

ACL 2024findings

Multimodal entity linking (MEL) aims to link ambiguous mentions in multimodal contexts to entities in a multimodal knowledge graph. A pivotal challenge is to fully leverage multi-element correlations between mentions and entities to bridge modality gap and enable fine-grained semantic matching. Exis…