Lianggong Bruce Wen

Unveiling Visual Perception in Language Models: An Attention Head Analysis Approach

Recent advancements in Multimodal Large Language Models (MLLMs) have demonstrated remarkable progress in visual understanding. This impressive leap raises a compelling question: how can language models, initially trained solely on linguistic data, effectively interpret and process visual content? Th…