Huang Jing

OmniActor: A Generalist GUI and Embodied Agent for 2D&3D Worlds

Multimodal large language models are progressively advancing toward multimodal agents that can proactively execute tasks. Existing research on multimodal agents primarily targets either GUI or embodied scenarios, corresponding to interactions within 2D virtual world and 3D physical world, respective…