SegICP: Integrated deep semantic segmentation and pose estimation
Jay M. Wong, Vincent Kee, Tiffany Le, Syler Wagner, Gian-Luca Mariottini, Abraham Schneider, Lei Hamilton, Rahul Chipalkatty
Abstract
Recent robotic manipulation competitions have highlighted that sophisticated robots still struggle to achieve fast and reliable perception of task-relevant objects in complex, realistic scenarios. To improve these systems' perceptive speed and robustness, we present SegICP, a novel integrated solution to object recognition and pose estimation. SegICP couples convolutional neural networks and multi-hypothesis point cloud registration to achieve both robust pixel-wise semantic segmentation as well as accurate and real-time 6-DOF pose estimation for relevant objects. Our architecture achieves 1 cm position error and <; 5° angle error in real time without an initial seed. We evaluate and benchmark SegICP against an annotated dataset generated by motion capture.
BibTeX
@inproceedings{iros2017_segicpintegrated,
title = {SegICP: Integrated deep semantic segmentation and pose estimation},
author = {Jay M. Wong and Vincent Kee and Tiffany Le and Syler Wagner and Gian-Luca Mariottini and Abraham Schneider and Lei Hamilton and Rahul Chipalkatty and Mitchell Hebert and David M.S. Johnson and Jimmy Wu and Bolei Zhou and Antonio Torralba},
booktitle = {IROS 2017},
year = {2017}
}