UAV Target-Selection: 3D Pointing Interface System for Large-Scale Environment
Anna C. S. Medeiros, Photchara Ratsamee, Jason Orlosky, Yuki Uranishi, Manabu Higashida, Haruo Takemura
Abstract
This paper presents a 3D pointing interface application to signal a UAV’s target in a large-scale environment. This system enables UAVs equipped with a monocular camera to determine which window of a building is selected by a human user in large-scale indoor or outdoor environments. The 3D pointing interface consists of three parts: YOLO, Open- Pose, and ORB-SLAM. YOLO detects the target objects, e.g., windows, OpenPose extracts the user pose, and ORB-SLAM builds a scale-dependent 3D map, a set of 3D sparse feature points. To obtain the visual scale, it performs a calibration step with the user standing in front of the UAV at a certain distance. We detail how we chose the gesture, localize and detect objects, and transform between coordinate systems. The real- world experiment results showed that the 3D pointing interface obtained a 0.73 F1-score average and a 0.58 F1-Score at the maximum distance of 25 meters between UAV and building.
BibTeX
@inproceedings{icra2021_uavtargetselecti,
title = {UAV Target-Selection: 3D Pointing Interface System for Large-Scale Environment},
author = {Anna C. S. Medeiros and Photchara Ratsamee and Jason Orlosky and Yuki Uranishi and Manabu Higashida and Haruo Takemura},
booktitle = {ICRA 2021},
year = {2021}
}