Yaning Gao

VAGEN: Reinforcing World Model Reasoning for Multi-Turn VLM Agents

A major challenge in training VLM agents, compared to LLM agents, is that states shift from simple texts to complex visual observations, which introduces partial observability and demands robust world modeling. We ask: can VLM agents build internal world models through explicit visual state reasonin…