Exosense: A Vision-Based Scene Understanding System for Exoskeletons
Jianeng Wang, Matías Mattamala, Christina Kassab, Guillaume Burger, Fabio Elnecave Xavier, Lintong Zhang, Marine Pétriaux, Maurice F. Fallon
Abstract
Self-balancing exoskeletons are a key enabling technology for individuals with mobility impairments. While the current challenges focus on human-compliant hardware and control, unlocking their use for daily activities requires a scene perception system. In this work, we present <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Exosense</i>, a vision-centric scene understanding system for self-balancing exoskeletons. We introduce a multi-sensor visual-inertial mapping device as well as a navigation stack for state estimation, terrain mapping, and long-term operation. We tested Exosense attached to both a human leg and Wandercraft's <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">Personal Exoskeleton</i> in real-world indoor scenarios. This enabled us to test the system during typical periodic walking gaits, as well as future uses in multi-story environments. We demonstrate that Exosense can achieve an odometry drift of about 4 cm per meter traveled, and construct terrain maps under 1 cm average reconstruction error. It can also work in a visual localization mode in a previously mapped environment, providing a step towards long-term operation of exoskeletons.
BibTeX
@inproceedings{ral2025_exosenseavisionb,
title = {Exosense: A Vision-Based Scene Understanding System for Exoskeletons},
author = {Jianeng Wang and Matías Mattamala and Christina Kassab and Guillaume Burger and Fabio Elnecave Xavier and Lintong Zhang and Marine Pétriaux and Maurice F. Fallon},
booktitle = {RA-L 2025},
year = {2025}
}