2026
Trifuse: Enhancing Attention-Based GUI Grounding via Multimodal Fusion
ICML 2026poster
GUI grounding maps natural language instructions to the correct interface elements, serving as the perception foundation for GUI agents. Existing approaches predominantly rely on fine-tuning multimodal large language models (MLLMs) using large-scale GUI datasets to predict target element coordinates…