Investigation of Attitude Tracking Using an Integrated Inertial and Magnetic Navigation System for Hand-Held Surgical Instruments

Due to the need for accurate navigation in minimally invasive surgery, many methods have been introduced to the operating room for tracking the position and orientation of instruments. This paper considers the subproblem of using integrated inertial and magnetic sensing to track the attitude (orientation) of surgical instruments. In this scenario, it is usually assumed that the sensor is quasi-static and the surrounding magnetic field is steady. For practical hand-held surgical instruments, perturbations exist due to intended and unintended (e.g., tremor) motion and due to distortion of the surrounding magnetic field. We consider the problem of estimating the gravity and magnetic field in the inertial sensor frame with small perturbations. The dynamics of the gravity and magnetic field is studied under perturbations, their relationships to gyroscope measurements are analyzed, and Kalman filters (KFs) are formulated to reduce these perturbations. The estimated gravity and magnetic values (outputs of the KFs) are subsequently used in an extended KF for attitude estimation. In this filter, the prediction model is given by the system dynamics, formulated using quaternions, and the observation model is given by vector analysis of the estimated gravity and magnetic field. Experiments are performed to validate the algorithms under clinically realistic motions. The complete system demonstrates an improvement in the accuracy of the attitude estimate in the presence of small perturbations, and satisfies the specified accuracy requirement of 1°.

[1]  Zion Tsz Ho Tse,et al.  System for 3-D Real-Time Tracking of MRI-Compatible Devices by Image Processing , 2008, IEEE/ASME Transactions on Mechatronics.

[2]  Angelo M. Sabatini,et al.  Quaternion-based extended Kalman filter for determining orientation by inertial and magnetic sensing , 2006, IEEE Transactions on Biomedical Engineering.

[3]  Peter Kazanzides,et al.  Hybrid attitude estimation for laparoscopic surgical tools: A preliminary study , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[4]  Gerd Hirzinger,et al.  Automatic tracking of laparoscopic instruments by color coding , 1997, CVRMed.

[5]  M. Bozorg,et al.  A Decentralized Architecture for Simultaneous Localization and Mapping , 2009, IEEE/ASME Transactions on Mechatronics.

[6]  D. Simon Optimal State Estimation: Kalman, H Infinity, and Nonlinear Approaches , 2006 .

[7]  K. Cleary,et al.  Image Guided Interventions. , 2020, Biomedizinische Technik. Biomedical engineering.

[8]  Robert B. McGhee,et al.  An extended Kalman filter for quaternion-based orientation estimation using MARG sensors , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[9]  Volodymyr V. Kindratenko,et al.  A survey of electromagnetic position tracker calibration techniques , 2005, Virtual Reality.

[10]  Peter Kazanzides,et al.  Software components and frameworks for medical robot control , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[11]  P. Veltink,et al.  Compensation of magnetic disturbances improves inertial and magnetic sensing of human body segment orientation , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  Gabor Fichtinger,et al.  OpenIGTLink: an open network protocol for image‐guided therapy environment , 2009, The international journal of medical robotics + computer assisted surgery : MRCAS.

[13]  Malcolm J. Joyce,et al.  Tracking of internal organ motion with a six degree-of-freedom MEMS sensor: concept and simulation study , 2008 .

[14]  Gregory D. Hager,et al.  Task versus Subtask Surgical Skill Evaluation of Robotic Minimally Invasive Surgery , 2009, MICCAI.

[15]  Dogu Teber,et al.  Robotic and imaging in urological surgery , 2009, Current opinion in urology.

[16]  Yoshikazu Nakajima,et al.  3D Ultrasound System Using a Magneto-optic Hybrid Tracker for Augmented Reality Visualization in Laparoscopic Liver Surgery , 2002, MICCAI.

[17]  Malcolm J. Joyce,et al.  Wireless inertial sensor for tumour motion tracking , 2007 .

[18]  Aaron Fenster,et al.  Mechanically assisted 3D ultrasound guided prostate biopsy system. , 2008, Medical physics.

[19]  K. Cleary,et al.  Image-guided interventions : technology and applications , 2008 .

[20]  Keith J. Rebello,et al.  Applications of MEMS in surgery , 2004, Proceedings of the IEEE.

[21]  Frank Chongwoo Park,et al.  Robot sensor calibration: solving AX=XB on the Euclidean group , 1994, IEEE Trans. Robotics Autom..

[22]  Jack B. Kuipers,et al.  Quaternions and Rotation Sequences: A Primer with Applications to Orbits, Aerospace and Virtual Reality , 2002 .

[23]  Robert D. Howe,et al.  Real-time 3D ultrasound-based servoing of a surgical instrument , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[24]  J. Farrell,et al.  The global positioning system and inertial navigation , 1999 .

[25]  Ching-Chih Tsai,et al.  Ultrasonic Localization and Pose Tracking of an Autonomous Mobile Robot via Fuzzy Adaptive Extended Information Filtering , 2008, IEEE Transactions on Instrumentation and Measurement.