2026
WinDeskGround: A Benchmark for Robust GUI Grounding in Complex Multi-Window Desktop Environments
ICML 2026poster
Multimodal Large Language Models (MLLMs) have revolutionized GUI automation, yet their efficacy is largely established on idealized, single-layer interfaces. This paper identifies a critical reliability gap: state-of-the-art agents face distinct robustness challenges in real-world desktop environmen…