Improving Rigid 3-D Calibration for Robotic Surgery

Autonomy is the next frontier of research in robotic surgery and its aim is to improve the quality of surgical procedures in the next future. One fundamental requirement for autonomy is advanced perception capability through vision sensors. In this article, we propose a novel calibration technique for a surgical scenario with a da Vinci® Research Kit (dVRK) robot. Camera and robotic arms calibration are necessary to precise position and emulate expert surgeon. The novel calibration technique is tailored for RGB-D cameras. Different tests performed on relevant use cases prove that we significantly improve precision and accuracy with respect to state of the art solutions for similar devices on a surgical-size setups. Moreover, our calibration method can be easily extended to standard surgical endoscope used in real surgical scenario.

[1]  S. Duke Herrell,et al.  Toward image-guided robotic surgery: determining intrinsic accuracy of the da Vinci robot , 2006, International Journal of Computer Assisted Radiology and Surgery.

[2]  Riccardo Muradore,et al.  Cognitive Robotic Architecture for Semi-Autonomous Execution of Manipulation Tasks in a Surgical Environment , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  Peter Kazanzides,et al.  The Importance of Accuracy Measurement Standards for Computer-Integrated Interventional Systems , 2010 .

[4]  Stefan Fuchs.  Calibration and Multipath Mitigation for Increased Accuracy of Time-of-Flight Camera Measurements in Robotic Applications , 2012 .

[5]  Paolo Fiorini,et al.  Challenges of Autonomous Robotic Surgery , 2019 .

[6]  Mehrdad R. Kermani,et al.  A New Formulation for Hand–Eye Calibrations as Point-Set Matching , 2020, IEEE Transactions on Instrumentation and Measurement.

[7]  Mili Shah,et al.  An overview of robot-sensor calibration methods for evaluation of perception systems , 2012, PerMIS.

[8]  Danail Stoyanov,et al.  Hand-eye calibration for robotic assisted minimally invasive surgery without a calibration object , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[9]  Yunhui Liu,et al.  Vision-Based Calibration of Dual RCM-Based Robot Arms in Human-Robot Collaborative Minimally Invasive Surgery , 2018, IEEE Robotics and Automation Letters.

[10]  Svenja Kahn,et al.  Hand-eye calibration with a depth camera: 2D or 3D? , 2014, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[11]  Allison M. Okamura,et al.  3-D Ultrasound-Guided Robotic Needle Steering in Biological Tissue , 2014, IEEE Transactions on Biomedical Engineering.

[12]  Ronghua Liang,et al.  Hand-eye calibration with a new linear decomposition algorithm , 2008 .

[13]  Yiu Cheung Shiu,et al.  Calibration of wrist-mounted robotic sensors by solving homogeneous transform equations of the form AX=XB , 1989, IEEE Trans. Robotics Autom..

[14]  Riccardo Muradore,et al.  Rigid 3D Registration of Pre-operative Information for Semi-Autonomous Surgery , 2020, 2020 International Symposium on Medical Robotics (ISMR).

[15]  Hui Pan,et al.  A closed-form solution to eye-to-hand calibration towards visual grasping , 2014, Ind. Robot.

[16]  Roger Y. Tsai,et al.  A new technique for fully autonomous and efficient 3D robotics hand/eye calibration , 1988, IEEE Trans. Robotics Autom..

[17]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[18]  Jack C. K. Chou,et al.  Finding the Position and Orientation of a Sensor on a Robot Manipulator Using Quaternions , 1991, Int. J. Robotics Res..

[19]  Purang Abolmaesumi,et al.  A closed-form differential formulation for ultrasound spatial calibration: multi-wedge phantom. , 2014, Ultrasound in medicine & biology.

[20]  Sébastien Ourselin,et al.  Combined 2D and 3D tracking of surgical instruments for minimally invasive and robotic-assisted surgery , 2016, International Journal of Computer Assisted Radiology and Surgery.

[21]  Jirí Hrebícek,et al.  Solving Problems in Scientific Computing Using Maple and MATLAB® , 2004, Springer Berlin Heidelberg.

[22]  Dong Whan Kim,et al.  Hand/Eye Calibration Using 3D-3D Correspondences , 2013 .

[23]  Kejing He,et al.  Hand-Eye Calibration of Surgical Instrument for Robotic Surgery Using Interactive Manipulation , 2020, IEEE Robotics and Automation Letters.

[24]  Matthew O. Ward,et al.  Interactive Data Visualization: Foundations, Techniques, and Applications, Second Edition - 360 Degree Business , 2015 .