2022
A Real-Time Online Learning Framework for Joint 3D Reconstruction and Semantic Segmentation of Indoor Scenes
Davide Menini, Suryansh Kumar, Martin R. Oswald, Erik Sandström, Cristian Sminchisescu, Luc Van Gool
RA-L 2022
This letter presents a real-time online vision framework to jointly recover an indoor scene’s 3D structure and semantic label. Given noisy depth maps, a camera trajectory, and 2D semantic labels at train time, the proposed deep neural network based approach learns to fuse the depth over frames with