Vision-Based Calibration of Dual RCM-Based Robot Arms in Human-Robot Collaborative Minimally Invasive Surgery
Zerui Wang, Ziwei Liu, Qianli Ma, Alexis Cheng, Yunhui Liu, Sungmin Kim, Anton Deguet, Austin Reiter
Abstract
This letter reports the development of a vision-based calibration method for dual remote center-of-motion (RCM) based robot arms in a human-robot collaborative minimally invasive surgery (MIS) scenario. The method does not require any external tracking sensors and directly uses images captured by the endoscopic camera and the robot encoder readings as calibration data, which leads to a minimal and practical system in the operating room. By taking advantage of the motion constraints imposed by the RCM-based kinematics of the robotic surgical tools and cameras, we can find unique relationships between the endoscope and the surgical tool using camera perspective projection geometry without the geometric information of the tool. A customized vision-based centerline detection algorithm is also proposed, which provides robust estimation of centerline positions for a variety of settings. We validate the method through simulations and an experimental study in a simulated MIS scenario, in which the first generation da Vinci surgical system controlled by the open source da Vinci research kit electronics and cisst/SAW software environment is used.
BibTeX
@inproceedings{ral2018_visionbasedcalib,
title = {Vision-Based Calibration of Dual RCM-Based Robot Arms in Human-Robot Collaborative Minimally Invasive Surgery},
author = {Zerui Wang and Ziwei Liu and Qianli Ma and Alexis Cheng and Yunhui Liu and Sungmin Kim and Anton Deguet and Austin Reiter and Peter Kazanzides and Russell H. Taylor},
booktitle = {RA-L 2018},
year = {2018}
}