Yongshuai Hou

Evaluating and Steering Modality Preferences in Multi-modal LLMs

Multi-modal large language models (MLLMs) have achieved remarkable success on complex multi-modal tasks. However, it remains insufficiently explored whether they exhibit \textit{modality preference}, a tendency to favor one modality over another when processing multi-modal contexts. To study this qu…