Minglong Tang

VGA: Vision GUI Assistant - Minimizing Hallucinations through Image-Centric Fine-Tuning

Large Vision-Language Models (VLMs) have already been applied to the understanding of Graphical User Interfaces (GUIs) and have achieved notable results. However, existing VLMs often overly rely on internal text-based knowledge while neglecting visual inputs. This imbalance may lead models to produc…