Unscented Kalman Filter Based Sensor Fusion for Robust Optical and Electromagnetic Tracking in Surgical Navigation

Computer-aided surgery systems provide visual guidance to surgeons by showing the real-time pose of surgical instruments overlaid on preoperative medical images of the patient. Surgical instrument poses are localized in space using mainly optical tracking systems (OTS) and electromagnetic tracking systems (EMTS). OTS systems require clear line-of-sight, which is difficult to ensure in current overcrowded operating rooms. On the other hand, EMTSs provide less accuracy and suffer from magnetic field distortion in the presence of metal objects. In this paper, we propose a sensor fusion algorithm to compensate for the drawbacks of OTS and EMTS, and achieve robust tracking of surgical instruments. Spatial alignment of OTS and EMTS data will be achieved through a calibration procedure. The proposed sensor fusion algorithm uses an unscented Kalman filter (UKF), an extension of the standard Kalman filter based on a deterministic sampling of nonlinear functions. Quaternion representation for rotations is used to avoid singularities of other parameterizations (e.g., Euler angles). In cases of optical marker occlusion, our algorithm will take advantage of the EMTS to estimate the position of the hidden marker(s) and feed it in the UKF. The fusion algorithm will also keep track of an error matrix between OTS and EMTS measured poses, providing an up-to-date estimate of the electromagnetic distortion. This will be used to correct EMTS measurement before using it to compensate for possible optical line-of-sight occlusions. The proposed sensor fusion (SF) method is compared to a predictive UKF based on optical data (NSF). Our results show that the SF effectively compensates for short marker occlusion (nine samples) providing a continuous estimate of the instrument pose with an error significantly lower than the NSF method, and reaching a clinically acceptable accuracy. Furthermore, the proposed algorithm increases the accuracy of EMTS in the presence of magnetic field distortion.

[1]  F. Sebastian Grassia,et al.  Practical Parameterization of Rotations Using the Exponential Map , 1998, J. Graphics, GPU, & Game Tools.

[2]  P. Grunert,et al.  Computer-aided navigation in neurosurgery , 2003, Neurosurgical Review.

[3]  K. Cleary,et al.  Electromagnetic tracking for abdominal interventions in computer aided surgery , 2006, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[4]  Guang-Zhong Yang,et al.  Freehand Cocalibration of Optical and Electromagnetic Trackers for Navigated Bronchoscopy , 2004, MIAR.

[5]  Leopoldo Angrisani,et al.  Unscented transform: a powerful tool for measurement uncertainty evaluation , 2005, IEEE Transactions on Instrumentation and Measurement.

[6]  Russell H. Taylor,et al.  Computers in imaging and guided surgery , 2001, Comput. Sci. Eng..

[7]  Russell H. Taylor,et al.  A miniature microsurgical instrument tip force sensor for enhanced force feedback during robot-assisted manipulation , 2003, IEEE Trans. Robotics Autom..

[8]  Torsten Söderström,et al.  Using an extended kalman filter for rigid body pose estimation. , 2005, Journal of biomechanical engineering.

[9]  Hubert Zangl,et al.  Optimal Design of Multiparameter Multisensor Systems , 2008, IEEE Transactions on Instrumentation and Measurement.

[10]  Andrew D. Wiles,et al.  Accuracy assessment protocols for elektromagnetic tracking systems , 2003, CARS.

[11]  L. De Vito,et al.  One-Way Delay Measurement: State of Art , 2008, 2006 IEEE Instrumentation and Measurement Technology Conference Proceedings.

[12]  Giancarlo Ferrigno,et al.  Modular multiple sensors information management for computer‐integrated surgery , 2012, The international journal of medical robotics + computer assisted surgery : MRCAS.

[13]  T. Haidegger,et al.  Accuracy improvement of a neurosurgical robot system , 2008, 2008 2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[14]  Gerd Hirzinger,et al.  Robust multi sensor pose estimation for medical applications , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Robert D. Howe,et al.  Increasing Accuracy in Image-Guided Robotic Surgery Through Tip Tracking and Model-Based Flexion Correction , 2009, IEEE Transactions on Robotics.

[16]  Giancarlo Ferrigno,et al.  Application of unscented Kalman filter for robust pose estimation in image-guided surgery , 2012, Medical Imaging.

[17]  Jeffrey K. Uhlmann,et al.  Unscented filtering and nonlinear estimation , 2004, Proceedings of the IEEE.

[18]  Russell H. Taylor,et al.  Medical robotics in computer-integrated surgery , 2003, IEEE Trans. Robotics Autom..

[19]  Giancarlo Ferrigno,et al.  Hip joint centre localisation with an unscented Kalman filter , 2013, Computer methods in biomechanics and biomedical engineering.

[20]  Giancarlo Ferrigno,et al.  In-vitro experimental assessment of a new robust algorithm for hip joint centre estimation. , 2009, Journal of biomechanics.

[21]  Giancarlo Ferrigno,et al.  Robotic alignment of femoral cutting mask during total knee arthroplasty , 2008, International Journal of Computer Assisted Radiology and Surgery.

[22]  Russell H. Taylor,et al.  Medical Robotic Systems in Computer-Integrated Surgery , 2003 .

[23]  Thiagalingam Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation , 2001 .

[24]  J. Krücker,et al.  Electromagnetic tracking for thermal ablation and biopsy guidance: clinical evaluation of spatial accuracy. , 2007, Journal of vascular and interventional radiology : JVIR.

[25]  Jian Qiu Zhang,et al.  An Unscented Kalm an Filter-Based MultisensorTrack Fusion Algorithm , 2005, 2005 IEEE Instrumentationand Measurement Technology Conference Proceedings.

[26]  Hui Zhang,et al.  Electromagnetic Tracking for Image-Guided Abdominal Procedures: Overall System and Technical Issues , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[27]  Nassir Navab,et al.  Magneto-Optic Tracking of a Flexible Laparoscopic Ultrasound Transducer for Laparoscope Augmentation , 2007, MICCAI.

[28]  Jeffrey K. Uhlmann,et al.  New extension of the Kalman filter to nonlinear systems , 1997, Defense, Security, and Sensing.

[29]  K. Dietmayer,et al.  DATA SYNCHRONIZATION STRATEGIES FOR MULTI-SENSOR FUSION , 2003 .

[30]  E. Kraft,et al.  A quaternion-based unscented Kalman filter for orientation tracking , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[31]  K. Cleary,et al.  Navigation with electromagnetic tracking for interventional radiology procedures: a feasibility study. , 2005, Journal of vascular and interventional radiology : JVIR.

[32]  Peter Anderson,et al.  Method for estimating dynamic EM tracking accuracy of surgical navigation tools , 2006, SPIE Medical Imaging.

[33]  Seong-Young Ko,et al.  Closed-Loop Planar Motion Control of a Steerable Probe With a “Programmable Bevel” Inspired by Nature , 2011, IEEE Transactions on Robotics.

[34]  Umer Zeeshan Ijaz,et al.  Electrical resistance imaging of a time-varying interface in stratified flows using an unscented Kalman filter , 2008 .

[35]  D. Obradovic,et al.  Synchronization Performance of the Precision Time Protocol , 2007, 2007 IEEE International Symposium on Precision Clock Synchronization for Measurement, Control and Communication.

[36]  D Hawkes,et al.  Image-guided navigation in oral and maxillofacial surgery. , 2005, The British journal of oral & maxillofacial surgery.

[37]  G Ferrigno,et al.  Robust recovery of human motion from video using Kalman filters and virtual humans. , 2003, Human movement science.

[38]  Kristin D Zhao,et al.  Kinematic study of the mandible using an electromagnetic tracking device and custom dental appliance: introducing a new technique. , 2006, Journal of biomechanics.

[39]  Peter H. Veltink,et al.  Ambulatory Position and Orientation Tracking Fusing Magnetic and Inertial Sensing , 2007, IEEE Transactions on Biomedical Engineering.

[40]  A.L. Simpson,et al.  Computation and Validation of Intra- operative Camera Uncertainty , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[41]  Sandro Fioretti,et al.  Signal processing in movement analysis (a state-space approach) , 1996 .

[42]  Peter Kazanzides,et al.  Multisensor Data Fusion in an Integrated Tracking System for Endoscopic Surgery , 2012, IEEE Transactions on Information Technology in Biomedicine.