Design, Implementation, and Fundamental Limits of Image and RF Based Wireless Capsule Endoscopy Hybrid Localization

Precise localization of Wireless Capsule Endoscopy (WCE) inside the curly, long, and compact small intestine remains a challenging problem facing researchers for more than a decade. Conventional Radio Frequency (RF) localization techniques, commonly used in outdoor and indoor area, have demonstrated a few centimeters accuracy when applying to the inside of human body. In this paper, using 3D Posterior Cramer-Rao Lower Bound (PCRLB) as a framework for performance evaluation, we demonstrated that millimetric accuracy can be achieved using hybrid RF and image processing localization technique. This level of accuracy enables precise simultaneous localization and mapping of the WCE movement path inside the small intestine. Using the PCRLB framework, we provided in-depth analysis on hybrid localization performance regarding the effects of WCE movement estimation, the effects of system bandwidth as well as the effects of on-body sensor numbers and placements.

[1]  F. Gustafsson,et al.  Mobile positioning using wireless networks: possibilities and fundamental limitations based on available wireless network measurements , 2005, IEEE Signal Processing Magazine.

[2]  Ilangko Balasingham,et al.  Propagation models for IEEE 802.15.6 standardization of implant communication in body area networks , 2013, IEEE Communications Magazine.

[3]  Gursel Alici,et al.  Concept and simulation study of a novel localization method for robotic endoscopic capsules using multiple positron emission markers. , 2014, Medical physics.

[4]  Kaveh Pahlavan,et al.  Design and Validation of a Virtual Environment for Experimentation inside the Small Intestine , 2013, BODYNETS.

[5]  Sylvain Martel,et al.  Flagellated Magnetotactic Bacteria as Controlled MRI-trackable Propulsion and Steering Systems for Medical Nanorobots Operating in the Human Microvasculature , 2009, Int. J. Robotics Res..

[6]  S. Nam,et al.  Outer-Wall Loop Antenna for Ultrawideband Capsule Endoscope System , 2010, IEEE Antennas and Wireless Propagation Letters.

[7]  T. Shah,et al.  Development of a Tracking Algorithm for an In-Vivo RF Capsule Prototype , 2006, 2006 International Conference on Electrical and Computer Engineering.

[8]  Kaveh Pahlavan,et al.  Enlighten Wearable Physiological Monitoring Systems: On-Body RF Characteristics Based Human Motion Classification Using a Support Vector Machine , 2016, IEEE Transactions on Mobile Computing.

[9]  Sang-Chul Lee,et al.  Motion analysis for duplicate frame removal in wireless capsule endoscope , 2010, Medical Imaging.

[10]  Weihua Li,et al.  A Review of Localization Systems for Robotic Endoscopic Capsules , 2012, IEEE Transactions on Biomedical Engineering.

[11]  Kaveh Pahlavan,et al.  Comparison of TOA and RSS based techniques for RF localization inside human tissue , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[12]  Moe Z. Win,et al.  Fundamental Limits of Wideband Localization— Part I: A General Framework , 2010, IEEE Transactions on Information Theory.

[13]  A. J. Aschoff,et al.  Detection and localization of acute upper and lower gastrointestinal (GI) bleeding with arterial phase multi-detector row helical CT , 2008, European Radiology.

[14]  Harry L. Van Trees,et al.  Detection, Estimation, and Modulation Theory, Part I , 1968 .

[15]  Mao Li,et al.  A Cubic 3-Axis Magnetic Sensor Array for Wirelessly Tracking Magnet Position and Orientation , 2010, IEEE Sensors Journal.

[16]  Gregory D. Hager,et al.  Assessment of Crohn’s Disease Lesions in Wireless Capsule Endoscopy Images , 2012, IEEE Transactions on Biomedical Engineering.

[17]  P. Swain,et al.  Wireless capsule endoscopy. , 2002, The Israel Medical Association journal : IMAJ.

[18]  Kaveh Pahlavan,et al.  An empirical channel model for the effect of human body on ray tracing , 2013, 2013 IEEE 24th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC).

[19]  Alfred O. Hero,et al.  Relative location estimation in wireless sensor networks , 2003, IEEE Trans. Signal Process..

[20]  H. Vincent Poor,et al.  An Introduction to Signal Detection and Estimation , 1994, Springer Texts in Electrical Engineering.

[21]  Kaveh Pahlavan,et al.  RF Localization for Wireless Video Capsule Endoscopy , 2012, Int. J. Wirel. Inf. Networks.

[22]  M.Q.-H. Meng,et al.  A Linear Algorithm for Tracing Magnet Position and Orientation by Using Three-Axis Magnetic Sensors , 2007, IEEE Transactions on Magnetics.

[23]  Kaveh Pahlavan,et al.  Comparative Performance Evaluation of RF Localization for Wireless Capsule Endoscopy Applications , 2014, International Journal of Wireless Information Networks.

[24]  Moe Z. Win,et al.  Fundamental Limits of Wideband Localization— Part II: Cooperative Networks , 2010, IEEE Transactions on Information Theory.

[25]  Alexandros Karargyris,et al.  OdoCapsule: Next-Generation Wireless Capsule Endoscopy With Accurate Lesion Localization and Video Stabilization Capabilities , 2015, IEEE Transactions on Biomedical Engineering.

[26]  Kaveh Pahlavan,et al.  Modeling of the Movement of the Endoscopy Capsule inside G . I . Tract based on the Captured Endoscopic Images , 2012 .

[27]  Max Q.-H. Meng,et al.  3D reconstruction of the WCE images by affine SIFT method , 2011, 2011 9th World Congress on Intelligent Control and Automation.

[28]  Fei Liu,et al.  CC-KF: Enhanced TOA Performance in Multipath and NLOS Indoor Extreme Environment , 2014, IEEE Sensors Journal.

[29]  Kaveh Pahlavan,et al.  Hybrid Localization of Microrobotic Endoscopic Capsule Inside Small Intestine by Data Fusion of Vision and RF Sensors , 2015, IEEE Sensors Journal.

[30]  Li Liu,et al.  Hybrid magnetic and vision localization technique of capsule endoscope for 3D recovery of pathological tissues , 2011, 2011 9th World Congress on Intelligent Control and Automation.

[31]  I Balasingham,et al.  On ultra wideband channel modeling for in-body communications , 2010, IEEE 5th International Symposium on Wireless Pervasive Computing 2010.

[32]  Kaveh Pahlavan,et al.  Analysis of three-dimensional maximum likelihood algorithm for capsule endoscopy localization , 2012, 2012 5th International Conference on BioMedical Engineering and Informatics.

[33]  Kaveh Pahlavan,et al.  On the accuracy of RF positioning in multi-Capsule endoscopy , 2011, 2011 IEEE 22nd International Symposium on Personal, Indoor and Mobile Radio Communications.

[34]  P. Dario,et al.  Capsule Endoscopy: From Current Achievements to Open Challenges , 2011, IEEE Reviews in Biomedical Engineering.

[35]  Kaveh Pahlavan,et al.  Accuracy of RSS-Based RF Localization in Multi-capsule Endoscopy , 2012, Int. J. Wirel. Inf. Networks.

[36]  Hao Sun,et al.  Detection and Localization of Active Gastrointestinal Bleeding With Multidetector Row Computed Tomography Angiography: A Five-year Prospective Study in One Medical Center , 2012, Journal of clinical gastroenterology.

[37]  Kaveh Pahlavan,et al.  Wideband characterization of RF propagation for TOA localization of Wireless video Capsule Endoscope inside small intestine , 2013, 2013 IEEE 24th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC).

[38]  Guanqun Bao,et al.  On Simultaneous Localization and Mapping inside the Human Body (Body-SLAM) , 2014 .

[39]  Wensheng Hou,et al.  Wearable magnetic locating and tracking system for MEMS medical capsule , 2008 .

[40]  Jordi Vitrià,et al.  Intestinal motor activity, endoluminal motion and transit , 2009, Neurogastroenterology and motility : the official journal of the European Gastrointestinal Motility Society.

[41]  Gabor Fichtinger,et al.  Design of a novel MRI compatible manipulator for image guided prostate interventions , 2005, IEEE Transactions on Biomedical Engineering.

[42]  Tharshan Vaithianathan,et al.  A Real-Time Tracking System for an Endoscopic Capsule using Multiple Magnetic Sensors , 2008 .

[43]  Andreas F. Molisch,et al.  Channel models for ultrawideband personal area networks , 2003, IEEE Wireless Communications.

[44]  K. Arshak,et al.  Adaptive Linearized Methods for Tracking a Moving Telemetry Capsule , 2007, 2007 IEEE International Symposium on Industrial Electronics.

[45]  Kaveh Pahlavan,et al.  Performance bounds for RF positioning of endoscopy camera capsules , 2011, 2011 IEEE Topical Conference on Biomedical Wireless Technologies, Networks, and Sensing Systems.

[46]  Kaveh Pahlavan,et al.  On effect of transmit power variance on localization accuracy in wireless capsule endoscopy , 2012, 2012 IEEE Wireless Communications and Networking Conference (WCNC).

[47]  D. Fischer,et al.  Capsule endoscopy: the localization system. , 2004, Gastrointestinal endoscopy clinics of North America.

[48]  Judith E. Terrill,et al.  A statistical path loss model for medical implant communication channels , 2009, 2009 IEEE 20th International Symposium on Personal, Indoor and Mobile Radio Communications.

[49]  Ryuji Kohno,et al.  Position Estimation Method of Medical Implanted Devices Using Estimation of Propagation Velocity inside Human Body , 2009, IEICE Trans. Commun..

[50]  Kaveh Pahlavan,et al.  Motion estimation of the endoscopy capsule using region-based Kernel SVM classifier , 2013, IEEE International Conference on Electro-Information Technology , EIT 2013.

[51]  Y. Hao,et al.  Modeling and Characterization of Biotelemetric Radio Channel From Ingested Implants Considering Organ Contents , 2009, IEEE Transactions on Antennas and Propagation.

[52]  Mark L. Fowler,et al.  A novel method for medical implant in-body localization , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[53]  Nikolaos G. Bourbakis,et al.  Detection of Small Bowel Polyps and Ulcers in Wireless Capsule Endoscopy Videos , 2011, IEEE Transactions on Biomedical Engineering.

[54]  R.L. Moses,et al.  Locating the nodes: cooperative localization in wireless sensor networks , 2005, IEEE Signal Processing Magazine.

[55]  Kaveh Pahlavan,et al.  Comparison of POA and TOA based ranging behavior for RFID application , 2014, 2014 IEEE 25th Annual International Symposium on Personal, Indoor, and Mobile Radio Communication (PIMRC).

[56]  P. Dario,et al.  Design, Fabrication, and Testing of a Capsule With Hybrid Locomotion for Gastrointestinal Tract Exploration , 2010, IEEE/ASME Transactions on Mechatronics.

[57]  K. Schulmann,et al.  Feasibility and Diagnostic Utility of Video Capsule Endoscopy for the Detection of Small Bowel Polyps in Patients with Hereditary Polyposis Syndromes , 2005, The American Journal of Gastroenterology.