AAAI 2026technical0 citations
Agent Journey Beyond RGB: Hierarchical Semantic-Spatial Representation Enrichment for Vision-and-Language Navigation
Xuesong Zhang, Yunbo Xu, Jia Li, Ruonan Liu, Zhenzhen Hu
Abstract
Navigating unseen environments based on natural language instructions remains difficult for egocentric agents in Vision-and-Language Navigation (VLN). Intuitively, humans inherently ground concrete semantic knowledge within spatial layouts during indoor navigation. Although previous studies have introduced diverse environmental representations to enhance reasoning, other co-occurrence modalities are often naively concatenated with RGB features, resulting in suboptimal utilization of each modality
BibTeX
@inproceedings{aaai2026_agentjourneybeyo,
title = {Agent Journey Beyond RGB: Hierarchical Semantic-Spatial Representation Enrichment for Vision-and-Language Navigation},
author = {Xuesong Zhang and Yunbo Xu and Jia Li and Ruonan Liu and Zhenzhen Hu},
booktitle = {AAAI 2026},
year = {2026}
}