Jacobian-Based Iterative Method for Magnetic Localization in Robotic Capsule Endoscopy

The purpose of this study is to validate a Jacobian-based iterative method for real-time localization of magnetically controlled endoscopic capsules. The proposed approach applies finite-element solutions to the magnetic field problem and least-squares interpolations to obtain closed-form and fast estimates of the magnetic field. By defining a closed-form expression for the Jacobian of the magnetic field relative to changes in the capsule pose, we are able to obtain an iterative localization at a faster computational time when compared with prior works, without suffering from the inaccuracies stemming from dipole assumptions. This new algorithm can be used in conjunction with an absolute localization technique that provides initialization values at a slower refresh rate. The proposed approach was assessed via simulation and experimental trials, adopting a wireless capsule equipped with a permanent magnet, six magnetic field sensors, and an inertial measurement unit. The overall refresh rate, including sensor data acquisition and wireless communication was 7 ms, thus enabling closed-loop control strategies for magnetic manipulation running faster than 100 Hz. The average localization error, expressed in cylindrical coordinates was below 7 mm in both the radial and axial components and 5$^\circ$ in the azimuthal component. The average error for the capsule orientation angles, obtained by fusing gyroscope and inclinometer measurements, was below 5$^\circ$.

[1]  Yoshihiko Nakamura,et al.  Advanced robotics - redundancy and optimization , 1990 .

[2]  P. Veltink,et al.  Estimating orientation with gyroscopes and accelerometers. , 1999, Technology and health care : official journal of the European Society for Engineering and Medicine.

[3]  Jian Zhang,et al.  Optimal Path Planning for Robotic Insertion of Steerable Electrode Arrays in Cochlear Implant Surgery , 2009 .

[4]  Mohinder S. Grewal,et al.  Global Positioning Systems, Inertial Navigation, and Integration , 2000 .

[5]  Peter Lancaster,et al.  The theory of matrices , 1969 .

[6]  K. Aminian,et al.  Quaternion-based fusion of gyroscopes and accelerometers to improve 3D angle measurement , 2006 .

[7]  James Cutler,et al.  Magnetic Sensor Calibration and Residual Dipole Characterization for Application to Nanosatellites , 2010 .

[8]  Pietro Valdastri,et al.  Real-Time Pose Detection for Magnetic Medical Devices , 2013, IEEE Transactions on Magnetics.

[9]  Jian Zhang,et al.  A Pilot Study of Robot-Assisted Cochlear Implant Surgery Using Steerable Electrode Arrays , 2006, MICCAI.

[10]  Frank Dellaert,et al.  iSAM2: Incremental smoothing and mapping using the Bayes tree , 2012, Int. J. Robotics Res..

[11]  Hugh F. Durrant-Whyte,et al.  Inertial navigation systems for mobile robots , 1995, IEEE Trans. Robotics Autom..

[12]  Jake J. Abbott,et al.  Localization method for a magnetic capsule endoscope propelled by a rotating magnetic dipole field , 2013, 2013 IEEE International Conference on Robotics and Automation.

[13]  Basilio Bona,et al.  A fast and accurate approximation for planar pose graph optimization , 2014, Int. J. Robotics Res..

[14]  Joe Brewer,et al.  Kronecker products and matrix calculus in system theory , 1978 .

[15]  M. B. Ignagni,et al.  Optimal strapdown attitude integration algorithms , 1990 .

[16]  Christian T.M. Baten,et al.  Estimation of orientation with gyroscopes and accelerometers , 1999, Proceedings of the First Joint BMES/EMBS Conference. 1999 IEEE Engineering in Medicine and Biology 21st Annual Conference and the 1999 Annual Fall Meeting of the Biomedical Engineering Society (Cat. N.

[17]  Gregory S. Chirikjian,et al.  A modal approach to hyper-redundant manipulator kinematics , 1994, IEEE Trans. Robotics Autom..

[18]  Daniel E. Whitney,et al.  Resolved Motion Rate Control of Manipulators and Human Prostheses , 1969 .

[19]  Paolo Dario,et al.  A New Mechanism for Mesoscale Legged Locomotion in Compliant Tubular Environments , 2009, IEEE Transactions on Robotics.

[20]  Metin Sitti,et al.  3-D Localization Method for a Magnetically Actuated Soft Capsule Endoscope and Its Applications , 2013, IEEE Transactions on Robotics.

[21]  Sarah Eichmann,et al.  Fourier Series And Orthogonal Functions , 2016 .

[22]  Qi Zhang,et al.  6-D Magnetic Localization and Orientation Method for an Annular Magnet Based on a Closed-Form Analytical Model , 2014, IEEE Transactions on Magnetics.

[23]  Syed Mahfuzul Aziz,et al.  A real-time localization system for an endoscopic capsule , 2014, ISSNIP.

[24]  Charles K. Toth,et al.  SOME ASPECTS OF USING FOURIER ANALYSIS TO SUPPORT SURFACE MODELING , 2005 .

[25]  Mao Li,et al.  A Cubic 3-Axis Magnetic Sensor Array for Wirelessly Tracking Magnet Position and Orientation , 2010, IEEE Sensors Journal.

[26]  R. Webster,et al.  Advanced technologies for gastrointestinal endoscopy. , 2012, Annual review of biomedical engineering.

[27]  Frank Dellaert,et al.  Factor graph based incremental smoothing in inertial navigation systems , 2012, 2012 15th International Conference on Information Fusion.

[28]  Weihua Li,et al.  A Review of Localization Systems for Robotic Endoscopic Capsules , 2012, IEEE Transactions on Biomedical Engineering.

[29]  Arianna Menciassi,et al.  Force calculation for localized magnetic driven capsule endoscopes , 2013, 2013 IEEE International Conference on Robotics and Automation.

[30]  Edward P. Furlani,et al.  A three-dimensional field solution for permanent-magnet axial-field motors , 1997 .

[31]  P Valdastri,et al.  A wireless platform for in vivo measurement of resistance properties of the gastrointestinal tract , 2014, Physiological measurement.

[32]  Jake J. Abbott,et al.  Five-degree-of-freedom manipulation of an untethered magnetic device in fluid using a single permanent magnet with application in stomach capsule endoscopy , 2016, Int. J. Robotics Res..