Hand–eye calibration for rigid laparoscopes using an invariant point

PurposeLaparoscopic liver resection has significant advantages over open surgery due to less patient trauma and faster recovery times, yet it can be difficult due to the restricted field of view and lack of haptic feedback. Image guidance provides a potential solution but one current challenge is in accurate “hand–eye” calibration, which determines the position and orientation of the laparoscope camera relative to the tracking markers.MethodsIn this paper, we propose a simple and clinically feasible calibration method based on a single invariant point. The method requires no additional hardware, can be constructed by theatre staff during surgical setup, requires minimal image processing and can be visualised in real time. Real-time visualisation allows the surgical team to assess the calibration accuracy before use in surgery. In addition, in the laboratory, we have developed a laparoscope with an electromagnetic tracking sensor attached to the camera end and an optical tracking marker attached to the distal end. This enables a comparison of tracking performance.ResultsWe have evaluated our method in the laboratory and compared it to two widely used methods, “Tsai’s method” and “direct” calibration. The new method is of comparable accuracy to existing methods, and we show RMS projected error due to calibration of 1.95 mm for optical tracking and 0.85 mm for EM tracking, versus 4.13 and 1.00 mm respectively, using existing methods. The new method has also been shown to be workable under sterile conditions in the operating room.ConclusionWe have proposed a new method of hand–eye calibration, based on a single invariant point. Initial experience has shown that the method provides visual feedback, satisfactory accuracy and can be performed during surgery. We also show that an EM sensor placed near the camera would provide significantly improved image overlay accuracy.

[1]  Mili Shah,et al.  An overview of robot-sensor calibration methods for evaluation of perception systems , 2012, PerMIS.

[2]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[4]  Sukryool Kang,et al.  Application of single-image camera calibration for ultrasound augmented laparoscopic visualization , 2015, Medical Imaging.

[5]  Michal Havlena,et al.  A branch-and-bound algorithm for globally optimal hand-eye calibration , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Heinrich Niemann,et al.  Data Selection for Hand-eye Calibration: A Vector Quantization Approach , 2008, Int. J. Robotics Res..

[7]  Paul Suetens,et al.  A System to Support Laparoscopic Surgery by Augmented Reality Visualization , 2001, MICCAI.

[8]  Yiu Cheung Shiu,et al.  Calibration of wrist-mounted robotic sensors by solving homogeneous transform equations of the form AX=XB , 1989, IEEE Trans. Robotics Autom..

[9]  Kostas Daniilidis,et al.  Hand-Eye Calibration Using Dual Quaternions , 1999, Int. J. Robotics Res..

[10]  A. Tsung,et al.  Comparative benefits of laparoscopic vs open hepatic resection: a critical appraisal. , 2011, Archives of surgery.

[11]  Edwin Olson,et al.  AprilCal: Assisted and repeatable camera calibration , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Roger Y. Tsai,et al.  A new technique for fully autonomous and efficient 3D robotics hand/eye calibration , 1988, IEEE Trans. Robotics Autom..

[13]  Jay B. West,et al.  Implementation, calibration and accuracy testing of an image-enhanced endoscopy system , 2002, IEEE Transactions on Medical Imaging.

[14]  David J. Hawkes,et al.  Improved Modelling of Tool Tracking Errors by Modelling Dependent Marker Errors , 2013, IEEE Transactions on Medical Imaging.

[15]  Ève Coste-Manière,et al.  Flexible Calibration of Actuated Stereoscopic Endoscope for Overlay in Robot Assisted Surgery , 2002, MICCAI.

[16]  Michel Dhome,et al.  Hand-eye calibration , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[17]  Kevin Cleary,et al.  Stereoscopic augmented reality for laparoscopic surgery , 2014, Surgical Endoscopy.

[18]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Takeo Kanade,et al.  Accurate camera calibration using iterative refinement of control points , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[20]  Sébastien Ourselin,et al.  Accuracy validation of an image guided laparoscopy system for liver resection , 2015, Medical Imaging.

[21]  Sébastien Ourselin,et al.  The NifTK software platform for image-guided interventions: platform overview and NiftyLink messaging , 2014, International Journal of Computer Assisted Radiology and Surgery.

[22]  Fadi Dornaika,et al.  Simultaneous robot-world and hand-eye calibration , 1998, IEEE Trans. Robotics Autom..

[23]  Charles Baur,et al.  Hybrid method for both calibration and registration of an endoscope with an active optical tracker , 2004, CARS.

[24]  Jack C. K. Chou,et al.  Finding the Position and Orientation of a Sensor on a Robot Manipulator Using Quaternions , 1991, Int. J. Robotics Res..

[25]  Sébastien Ourselin,et al.  Locally rigid, vessel-based registration for laparoscopic liver surgery , 2015, International Journal of Computer Assisted Radiology and Surgery.

[26]  Abed Malti,et al.  Hand–eye and radial distortion calibration for rigid endoscopes , 2013, The international journal of medical robotics + computer assisted surgery : MRCAS.

[27]  Luc Soler,et al.  A low cost and accurate guidance system for laparoscopic surgery: validation on an abdominal phantom , 2005, VRST '05.