Hand-eye calibration for surgical cameras: a Procrustean Perspective-n-Point solution

PurposeSurgical cameras are prevalent in modern operating theatres often used as surrogates for direct vision. A surgical navigational system is a useful adjunct, but requires an accurate “hand-eye” calibration to determine the geometrical relationship between the surgical camera and tracking markers.MethodsUsing a tracked ball-tip stylus, we formulated hand-eye calibration as a Perspective-n-Point problem, which can be solved efficiently and accurately using as few as 15 measurements.ResultsThe proposed hand-eye calibration algorithm was applied to three types of camera and validated against five other widely used methods. Using projection error as the accuracy metric, our proposed algorithm compared favourably with existing methods.ConclusionWe present a fully automated hand-eye calibration technique, based on Procrustean point-to-line registration, which provides superior results for calibrating surgical cameras when compared to existing methods.

[1]  Fadi Dornaika,et al.  Hand-Eye Calibration , 1995, Int. J. Robotics Res..

[2]  Frank Chongwoo Park,et al.  Robot sensor calibration: solving AX=XB on the Euclidean group , 1994, IEEE Trans. Robotics Autom..

[3]  J. Marescaux,et al.  Augmented-reality-assisted laparoscopic adrenalectomy. , 2004, JAMA.

[4]  Heinrich Niemann,et al.  Data Selection for Hand-eye Calibration: A Vector Quantization Approach , 2008, Int. J. Robotics Res..

[5]  Andrea Fusiello,et al.  Procrustean Point-Line Registration and the NPnP Problem , 2015, 2015 International Conference on 3D Vision.

[6]  Kostas Daniilidis,et al.  Hand-Eye Calibration Using Dual Quaternions , 1999, Int. J. Robotics Res..

[7]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[8]  Sébastien Ourselin,et al.  Hand–eye calibration for rigid laparoscopes using an invariant point , 2016, International Journal of Computer Assisted Radiology and Surgery.

[9]  Roger Y. Tsai,et al.  A new technique for fully autonomous and efficient 3D robotics hand/eye calibration , 1988, IEEE Trans. Robotics Autom..

[10]  Ziv Yaniv,et al.  Which pivot calibration? , 2015, Medical Imaging.

[11]  Jay B. West,et al.  The distribution of target registration error in rigid-body point-based registration , 2001, IEEE Transactions on Medical Imaging.

[12]  Michal Havlena,et al.  A branch-and-bound algorithm for globally optimal hand-eye calibration , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Gregory D. Hager,et al.  Fast and Globally Convergent Pose Estimation from Video Images , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Kevin Cleary,et al.  Stereoscopic augmented reality for laparoscopic surgery , 2014, Surgical Endoscopy.

[15]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  William E. Lorensen,et al.  Enhancing reality in the operating room , 1993, Proceedings Visualization '93.

[17]  V. Lepetit,et al.  EPnP: An Accurate O(n) Solution to the PnP Problem , 2009, International Journal of Computer Vision.

[18]  Terry M. Peters,et al.  Training for Planning Tumour Resection: Augmented Reality and Human Factors , 2015, IEEE Transactions on Biomedical Engineering.

[19]  Andrea Fusiello,et al.  Solving the PnP Problem with Anisotropic Orthogonal Procrustes Analysis , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[20]  Po-Wei Hsu,et al.  Freehand 3D Ultrasound Calibration: A Review , 2009 .

[21]  P. Schönemann,et al.  A generalized solution of the orthogonal procrustes problem , 1966 .

[22]  Terry M. Peters,et al.  Guided ultrasound calibration: where, how, and how many calibration fiducials , 2016, International Journal of Computer Assisted Radiology and Surgery.

[23]  Mili Shah,et al.  An overview of robot-sensor calibration methods for evaluation of perception systems , 2012, PerMIS.

[24]  Fadi Dornaika,et al.  Simultaneous robot-world and hand-eye calibration , 1998, IEEE Trans. Robotics Autom..

[25]  Dirk Bartz,et al.  Alternative online extrinsic calibration techniques for minimally invasive surgery , 2008, VRST '08.

[26]  Terry M. Peters,et al.  An augmented reality platform for planning of minimally invasive cardiac surgeries , 2012, Medical Imaging.

[27]  Terry M. Peters,et al.  Which point-line registration? , 2017, Medical Imaging.