Understanding while Exploring: Semantics-driven Active Mapping
Liyan Chen, Huangying Zhan, Hairong Yin, Yi Xu, Philippos Mordohai
Abstract
Effective robotic autonomy in unknown environments demands proactive exploration and precise understanding of both geometry and semantics. In this paper, we propose ActiveSGM, an active semantic mapping framework designed to predict the informativeness of potential observations before execution. Built upon a 3D Gaussian Splatting (3DGS) mapping backbone, our approach employs semantic and geometric uncertainty quantification, coupled with a sparse semantic representation, to guide exploration. By enabling robots to strategically select the most beneficial viewpoints, ActiveSGM efficiently enhances mapping completeness, accuracy, and robustness to noisy semantic data, ultimately supporting more adaptive scene exploration. Our experiments on the Replica and Matterport3D datasets highlight the effectiveness of ActiveSGM in active semantic mapping tasks.
BibTeX
@inproceedings{
chen2025understanding,
title={Understanding while Exploring: Semantics-driven Active Mapping},
author={Liyan Chen and Huangying Zhan and Hairong Yin and Yi Xu and Philippos Mordohai},
booktitle={The Thirty-ninth Annual Conference on Neural Information Processing Systems},
year={2025},
url={https://openreview.net/forum?id=RkHUDvy9QR}
}