Unveiling Non-Reproducibility in LiDAR-Inertial Odometry
Hongqian Huang, Meng Zhang, Jianchen Hu, Xiaohong Guan
Abstract
This letter presents empirical research on the non-reproducibility of light detection and ranging sensor (LiDAR)-inertial odometry (LIO) systems. Although the LIO community has made commendable efforts toward reproducible localization accuracy, <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">noteworthy</i> non-reproducibility remains, thus hindering a fair evaluation of method effectiveness. To better understand such non-reproducibility, we first define non-reproducibility and introduce a quantitative criterion to identify noteworthy non-reproducibility. We then propose five significant non-deterministic implementations that are included in state-of-the-art LIO systems and present solutions for modifying these non-deterministic implementations into deterministic ones. A general procedure is also introduced to identify and pinpoint non-deterministic implementations, regardless of whether they are covered in this letter. Extensive experiments demonstrate that the non-deterministic implementations are the major or potentially sole causes of non-reproducibility under constant experimental conditions. Additionally, the non-reproducibility is noteworthy in datasets obtained from low- vertical-resolution LiDARs or recorded in geometrically degenerate scenes.
BibTeX
@inproceedings{ral2026_unveilingnonrepr,
title = {Unveiling Non-Reproducibility in LiDAR-Inertial Odometry},
author = {Hongqian Huang and Meng Zhang and Jianchen Hu and Xiaohong Guan},
booktitle = {RA-L 2026},
year = {2026}
}