2026
UI-Ins: Enhancing GUI Grounding with Multi-Perspective Instruction as Reasoning
ICLR 2026poster
GUI grounding, which maps natural-language instructions to actionable UI elements, is a core capability of GUI agents. Prior work largely treats instructions as a static proxy for user intent, overlooking the impact of instruction diversity on grounding performance. Through a careful investigation o…