ZhiboZhang

GranViT: A Fine-Grained Vision Model With Autoregressive Perception For MLLMs

Vision encoders are indispensable for allowing impressive performance of Multimodal Large Language Models (MLLMs) in vision–language tasks such as visual question answering and reasoning. However, existing vision encoders focus on global image representations but overlook fine-grained regional analy…