Localization and Tracking of Implantable Biomedical Sensors

Implantable sensor systems are effective tools for biomedical diagnosis, visualization and treatment of various health conditions, attracting the interest of researchers, as well as healthcare practitioners. These systems efficiently and conveniently provide essential data of the body part being diagnosed, such as gastrointestinal (temperature, pH, pressure) parameter values, blood glucose and pressure levels and electrocardiogram data. Such data are first transmitted from the implantable sensor units to an external receiver node or network and then to a central monitoring and control (computer) unit for analysis, diagnosis and/or treatment. Implantable sensor units are typically in the form of mobile microrobotic capsules or implanted stationary (body-fixed) units. In particular, capsule-based systems have attracted significant research interest recently, with a variety of applications, including endoscopy, microsurgery, drug delivery and biopsy. In such implantable sensor systems, one of the most challenging problems is the accurate localization and tracking of the microrobotic sensor unit (e.g., robotic capsule) inside the human body. This article presents a literature review of the existing localization and tracking techniques for robotic implantable sensor systems with their merits and limitations and possible solutions of the proposed localization methods. The article also provides a brief discussion on the connection and cooperation of such techniques with wearable biomedical sensor systems.

[1]  Pietro Valdastri,et al.  Jacobian-Based Iterative Method for Magnetic Localization in Robotic Capsule Endoscopy , 2016, IEEE Transactions on Robotics.

[2]  M.Q.-H. Meng,et al.  Efficient Linear Algorithm for Magnetic Localization and Orientation in Capsule Endoscopy , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[3]  Mao Li,et al.  A Cubic 3-Axis Magnetic Sensor Array for Wirelessly Tracking Magnet Position and Orientation , 2010, IEEE Sensors Journal.

[4]  Brian D. O. Anderson,et al.  Adaptive range‐measurement‐based target pursuit , 2013 .

[5]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[6]  M.Q.-H. Meng,et al.  A Linear Algorithm for Tracing Magnet Position and Orientation by Using Three-Axis Magnetic Sensors , 2007, IEEE Transactions on Magnetics.

[7]  Xudong Guo,et al.  An electromagnetic localization method for medical micro-devices based on adaptive particle swarm optimization with neighborhood search , 2011 .

[8]  Weihua Li,et al.  An Effective Localization Method for Robotic Endoscopic Capsules Using Multiple Positron Emission Markers , 2014, IEEE Transactions on Robotics.

[9]  Susanne Winter,et al.  Phase difference based RFID navigation for medical applications , 2011, 2011 IEEE International Conference on RFID.

[10]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[11]  Billur Barshan,et al.  Investigating Inter-Subject and Inter-Activity Variations in Activity Recognition Using Wearable Motion Sensors , 2016, Comput. J..

[12]  James McNames,et al.  Review of Recent Patents on Wearable Movement Sensors , 2013 .

[13]  Baris Fidan,et al.  Adaptive Wireless Biomedical Capsule Tracking Based on Magnetic Sensing , 2017, Int. J. Wirel. Inf. Networks.

[14]  Jake J. Abbott,et al.  Proprioceptive magnetic-field sensing for closed-loop control of magnetic capsule endoscopes , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Ashraf Darwish,et al.  Wearable and Implantable Wireless Sensor Network Solutions for Healthcare Monitoring , 2011, Sensors.

[16]  Lazhar Khriji,et al.  Wearable wireless medical sensors toward standards, safety and intelligence: a review , 2014 .

[17]  D. Cave,et al.  Capsule Retention: It’s not all bad! , 2010 .

[18]  Fredrik Tufvesson,et al.  Localization of an RF source inside the Human body for Wireless Capsule Endoscopy , 2013, BODYNETS.

[19]  Min-Gyu Kim,et al.  Position and orientation detection of capsule endoscopes in spiral motion , 2010 .

[20]  Billur Barshan,et al.  Comparative study on classifying human activities with miniature inertial and magnetic sensors , 2010, Pattern Recognit..

[21]  Billur Barshan,et al.  Pedestrian dead reckoning employing simultaneous activity recognition cues , 2012 .

[22]  M. Fluckiger,et al.  Ultrasound Emitter Localization in Heterogeneous Media , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[23]  Baris Fidan,et al.  Localization Algorithms and Strategies for Wireless Sensor Networks: Monitoring and Surveillance Techniques for Target Tracking , 2009 .

[24]  Billur Barshan,et al.  Activity Recognition Invariant to Sensor Orientation with Wearable Motion Sensors , 2017, Sensors.

[25]  Alexandros Karargyris,et al.  OdoCapsule: Next-Generation Wireless Capsule Endoscopy With Accurate Lesion Localization and Video Stabilization Capabilities , 2015, IEEE Transactions on Biomedical Engineering.

[26]  Sarthak Misra,et al.  A preliminary study on using a Robotically-Actuated Delivery Sheath (RADS) for transapical aortic valve implantation , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[27]  Kaveh Pahlavan,et al.  On the accuracy of RF positioning in multi-Capsule endoscopy , 2011, 2011 IEEE 22nd International Symposium on Personal, Indoor and Mobile Radio Communications.

[28]  Brian D. O. Anderson,et al.  Wireless sensor network localization techniques , 2007, Comput. Networks.

[29]  Shyamal Patel,et al.  A review of wearable sensors and systems with application in rehabilitation , 2012, Journal of NeuroEngineering and Rehabilitation.

[30]  P. Dario,et al.  Frontiers of robotic endoscopic capsules: a review , 2016, Journal of Micro-Bio Robotics.

[31]  Pietro Valdastri,et al.  Real-Time Pose Detection for Magnetic Medical Devices , 2013, IEEE Transactions on Magnetics.

[32]  M. Meng,et al.  A novel RF-based propagation model with tissue absorption for location of the GI tract , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[33]  Anubhav Tripathi,et al.  Localization of magnetic pills , 2011, Proceedings of the National Academy of Sciences.

[34]  Sylvain Martel,et al.  Flagellated Magnetotactic Bacteria as Controlled MRI-trackable Propulsion and Steering Systems for Medical Nanorobots Operating in the Human Microvasculature , 2009, Int. J. Robotics Res..

[35]  Yongxin Zhu,et al.  Design and Implementation of a High Resolution Localization System for In-Vivo Capsule Endoscopy , 2009, 2009 Eighth IEEE International Conference on Dependable, Autonomic and Secure Computing.

[36]  Baris Fidan,et al.  Adaptive magnetic sensing based wireless capsule localization , 2016, 2016 10th International Symposium on Medical Information and Communication Technology (ISMICT).

[37]  Shuang Song,et al.  Locating Intra-Body Capsule Object by Three-Magnet Sensing System , 2016, IEEE Sensors Journal.

[38]  A. Karargyris,et al.  Wireless endoscopy in 2020: Will it still be a capsule? , 2015, World journal of gastroenterology.

[39]  R. Michael Buehrer,et al.  Handbook of Position Location: Theory, Practice and Advances , 2011 .

[40]  Stefano Stramigioli,et al.  Evaluation of robotically controlled advanced endoscopic instruments , 2013, The international journal of medical robotics + computer assisted surgery : MRCAS.

[41]  Gabor Fichtinger,et al.  Design of a novel MRI compatible manipulator for image guided prostate interventions , 2005, IEEE Transactions on Biomedical Engineering.

[42]  Xiaona Wang,et al.  Perspective of active capsule endoscope: actuation and localisation , 2011, Int. J. Mechatronics Autom..

[43]  Miguel A. Labrador,et al.  Survey on Fall Detection and Fall Prevention Using Wearable and External Sensors , 2014, Sensors.

[44]  Jake J. Abbott,et al.  Localization method for a magnetic capsule endoscope propelled by a rotating magnetic dipole field , 2013, 2013 IEEE International Conference on Robotics and Automation.

[45]  Metin Sitti,et al.  A 5-D Localization Method for a Magnetically Manipulated Untethered Robot Using a 2-D Array of Hall-Effect Sensors , 2016, IEEE/ASME Transactions on Mechatronics.

[46]  Subhas Chandra Mukhopadhyay,et al.  Wearable Sensors for Human Activity Monitoring: A Review , 2015, IEEE Sensors Journal.

[47]  Paul J. M. Havinga,et al.  A Survey of Online Activity Recognition Using Mobile Phones , 2015, Sensors.

[48]  Fatimah Ibrahim,et al.  Smartphone-Based Solutions for Fall Detection and Prevention: Challenges and Open Issues , 2014, Sensors.

[49]  Arnold Neumaier,et al.  Global Optimization by Multilevel Coordinate Search , 1999, J. Glob. Optim..

[50]  Billur Barshan,et al.  Automated evaluation of physical therapy exercises using multi-template dynamic time warping on wearable sensor signals , 2014, Comput. Methods Programs Biomed..

[51]  Mehmet Rasit Yuce,et al.  Propagation, Power Absorption, and Temperature Analysis of UWB Wireless Capsule Endoscopy Devices Operating in the Human Body , 2015, IEEE Transactions on Microwave Theory and Techniques.

[52]  T. Shah,et al.  Development of a Tracking Algorithm for an In-Vivo RF Capsule Prototype , 2006, 2006 International Conference on Electrical and Computer Engineering.

[53]  R. Michael Buehrer,et al.  Source Localization: Algorithms and Analysis , 2012 .

[54]  Gastone Ciuti,et al.  A discrete-time localization method for capsule endoscopy based on on-board magnetic sensing , 2011 .

[55]  Bill Bynum,et al.  Lancet , 2015, The Lancet.

[56]  K. Arshak,et al.  Adaptive Linearized Methods for Tracking a Moving Telemetry Capsule , 2007, 2007 IEEE International Symposium on Industrial Electronics.

[57]  L Nyberg,et al.  Comparison of real-life accidental falls in older people with experimental falls in middle-aged test subjects. , 2012, Gait & posture.

[58]  K. Arshak,et al.  Capsule tracking in the GI tract: a novel microcontroller based solution , 2006, Proceedings of the 2006 IEEE Sensors Applications Symposium, 2006..

[59]  Billur Barshan,et al.  Classifying Human Leg Motions with Uniaxial Piezoelectric Gyroscopes , 2009, Sensors.

[60]  Brian D. O. Anderson,et al.  Guaranteeing Practical Convergence in Algorithms for Sensor and Source Localization , 2008, IEEE Transactions on Signal Processing.

[61]  R. Webster,et al.  Advanced technologies for gastrointestinal endoscopy. , 2012, Annual review of biomedical engineering.

[62]  Kaveh Pahlavan,et al.  Hybrid Localization of Microrobotic Endoscopic Capsule Inside Small Intestine by Data Fusion of Vision and RF Sensors , 2015, IEEE Sensors Journal.

[63]  Max Q.-H. Meng,et al.  The Calibration of 3-Axis Magnetic Sensor Array System for Tracking Wireless Capsule Endoscope , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[64]  Baris Fidan,et al.  Adaptive Environmental Source Localization and Tracking with Unknown Permittivity and Path Loss Coefficients † , 2015, Sensors.

[65]  Sinan Gezici,et al.  A Survey on Wireless Position Estimation , 2008, Wirel. Pers. Commun..

[66]  P. Swain,et al.  Wireless capsule endoscopy. , 2002, The Israel Medical Association journal : IMAJ.

[67]  Xiuwen Liu,et al.  Accurate localization of RFID tags using phase difference , 2010, 2010 IEEE International Conference on RFID (IEEE RFID 2010).

[68]  Baris Fidan,et al.  Implant Localization in Human Body Using Adaptive Least-Squares Based Algorithm , 2013 .

[69]  W. Hasler,et al.  New vision in video capsule endoscopy: current status and future directions , 2012, Nature Reviews Gastroenterology &Hepatology.

[70]  Qiong Wang,et al.  Introduction to Body Area Communications , 2012 .

[71]  Bernt Schiele,et al.  A tutorial on human activity recognition using body-worn inertial sensors , 2014, CSUR.

[72]  Qiong Wang,et al.  Body Area Communications: Channel Modeling, Communication Systems, and EMC , 2012 .

[73]  M. Yu M2A™ Capsule Endoscopy: A Breakthrough Diagnostic Tool for Small Intestine Imaging , 2002, Gastroenterology nursing : the official journal of the Society of Gastroenterology Nurses and Associates.

[74]  Metin Sitti,et al.  3-D Localization Method for a Magnetically Actuated Soft Capsule Endoscope and Its Applications , 2013, IEEE Transactions on Robotics.

[75]  Max Q.-H. Meng,et al.  Efficient magnetic localization and orientation technique for capsule endoscopy , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[76]  Michael Frankfurter,et al.  Numerical Recipes In C The Art Of Scientific Computing , 2016 .

[77]  Mir Behrad Khamesee,et al.  Design, fabrication and control of a magnetic capsule-robot for the human esophagus , 2011 .

[78]  Ling Shao,et al.  A survey on fall detection: Principles and approaches , 2013, Neurocomputing.

[79]  Ahmet Turan Özdemir,et al.  An Analysis on Sensor Locations of the Human Body for Wearable Fall Detection Devices: Principles and Practice , 2016, Sensors.

[80]  Weihua Li,et al.  A Review of Localization Systems for Robotic Endoscopic Capsules , 2012, IEEE Transactions on Biomedical Engineering.

[81]  K. Arai,et al.  Numerical Study on the Improvement of Detection Accuracy for a Wireless Motion Capture System , 2009, IEEE Transactions on Magnetics.

[82]  Petros A. Ioannou,et al.  Adaptive control tutorial , 2006, Advances in design and control.

[83]  Kaveh Pahlavan,et al.  Design, Implementation, and Fundamental Limits of Image and RF Based Wireless Capsule Endoscopy Hybrid Localization , 2016, IEEE Transactions on Mobile Computing.

[84]  Yongxin Zhu,et al.  Design of 3D Positioning Algorithm Based on RFID Receiver Array for In Vivo Micro-Robot , 2009, 2009 Eighth IEEE International Conference on Dependable, Autonomic and Secure Computing.

[85]  Jessica Kilham,et al.  Crohn's and Colitis Foundation of America , 2014 .

[86]  D. Fischer,et al.  Capsule endoscopy: the localization system. , 2004, Gastrointestinal endoscopy clinics of North America.

[87]  R. S. Mackay,et al.  A pH-endoradiosonde. , 1957, Lancet.

[88]  Yunxing Ye,et al.  Bounds on RF cooperative localization for video capsule endoscopy , 2013 .

[89]  Yongxin Zhu,et al.  Design and Implementation of 3D Positioning Algorithms Based on RF Signal Radiation Patterns for In Vivo Micro-robot , 2010, 2010 International Conference on Body Sensor Networks.

[90]  Baris Fidan,et al.  Least‐squares‐based adaptive target localization by mobile distance measurement sensors , 2015 .

[91]  Yeun-Ho Joung,et al.  Implantable Bladder Sensors: A Methodological Review , 2015, International neurourology journal.

[92]  Max Q.-H. Meng,et al.  A novel radio propagation radiation model for location of the capsule in GI tract , 2009, 2009 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[93]  Surapa Thiemjarus,et al.  Automatic Fall Monitoring: A Review , 2014, Sensors.

[94]  Mehmet Rasit Yuce,et al.  Wireless Body Area Networks: Technology, Implementation, and Applications , 2011 .

[95]  Andrew Karellas,et al.  Computerized 3-dimensional localization of a video capsule in the abdominal cavity: validation by digital radiography. , 2014, Gastrointestinal endoscopy.

[96]  Kaveh Pahlavan,et al.  Performance bounds for RF positioning of endoscopy camera capsules , 2011, 2011 IEEE Topical Conference on Biomedical Wireless Technologies, Networks, and Sensing Systems.

[97]  Tim C. Lueth,et al.  Navigation of a robotic capsule endoscope with a novel ultrasound tracking system , 2013 .

[98]  Mark L. Fowler,et al.  Accurate Localization of In-Body Medical Implants Based on Spatial Sparsity , 2014, IEEE Transactions on Biomedical Engineering.

[99]  Mir Behrad Khamesee,et al.  Design and control of a magnetically driven capsule-robot for endoscopy and drug delivery , 2009, 2009 IEEE Toronto International Conference Science and Technology for Humanity (TIC-STH).

[100]  Evangelia Pippa,et al.  Investigation of Sensor Placement for Accurate Fall Detection , 2016, MobiHealth.

[101]  A. Glukhovsky,et al.  Small intestine/unclassifiedLocalization of the Given M2A® ingestible capsule in the Given® diagnostic imaging system , 2001 .