TC${2}$LI-SLAM: A Tightly-Coupled Camera-LiDAR-Inertial SLAM System
Yunze Tong, Xuebo Zhang, Runhua Wang, Zhixing Song, Songyang Wu, Shiyong Zhang, Youwei Wang, Jing Yuan
Abstract
In this letter, we propose TC<inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$^{2}$</tex-math></inline-formula>LI-SLAM, a novel and tightly-coupled camera-LiDAR-inertial SLAM system with a separated front end and a unified back end. The front end accepts non-identical frequency inputs and performs real-time pose estimation while incorporating different inputs into keyframes for the back end, benefiting from our novel keyframe-oriented data synchronization method. To improve the accuracy of the back-end optimization, we innovatively leverage multi-sensor consecutive co-vision constraints in a keyframe-based local bundle adjustment problem. To bridge the gap between different residual terms from different sensors in the optimization problem, we propose a cross-modal residual standardization method that can be easily applied. Furthermore, the proposed system can degrade into TC<inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$^{2}$</tex-math></inline-formula>L-SLAM, a tightly-coupled camera-LiDAR SLAM system without IMU, to cope with situations where inertial measurements are not available or reliable. Finally, both TC<inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$^{2}$</tex-math></inline-formula>LI-SLAM and TC<inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$^{2}$</tex-math></inline-formula>L-SLAM are tested on public and self-recorded datasets. The results show their superior performance in terms of accuracy compared with the state-of-the-art SLAM systems, with at most 33% accuracy improvement over ORB-SLAM3 on the KITTI dataset.
BibTeX
@inproceedings{ral2024_tc2lislamatightl,
title = {TC${2}$LI-SLAM: A Tightly-Coupled Camera-LiDAR-Inertial SLAM System},
author = {Yunze Tong and Xuebo Zhang and Runhua Wang and Zhixing Song and Songyang Wu and Shiyong Zhang and Youwei Wang and Jing Yuan},
booktitle = {RA-L 2024},
year = {2024}
}