Sequential image analysis for computer-aided wireless endoscopy

Wireless Capsule Endoscopy (WCE) is a technique for inner-visualization of the entire small intestine and, thus, offers an interesting perspective on intestinal motility. The two major drawbacks of this technique are: 1) huge amount of data acquired by WCE makes the motility analysis tedious and 2) since the capsule is the first tool that offers complete inner-visualization of the small intestine, the exact importance of the observed events is still an open issue. Therefore, in this thesis, a novel computer-aided system for intestinal motility analysis is presented. The goal of the system is to provide an easily-comprehensible visual description of motility-related intestinal events to a physician. In order to do it, several tools based either on computer vision concepts or on machine learning techniques are presented. A method for transforming 3D video signal to a holistic image of intestinal motility, called motility bar, is proposed. The method calculates the optimal mapping from video into image from the intestinal motility point of view. To characterize intestinal motility, methods for automatic extraction of motility information from WCE are presented. Two of them are based on the motility bar and two of them are based on frame-per-frame analysis. In particular, four algorithms dealing with the problems of intestinal contraction detection, lumen size estimation, intestinal content characterization and wrinkle frame detection are proposed and validated. The results of the algorithms are converted into sequential features using an online statistical test. This test is designed to work with multivariate data streams. To this end, we propose a novel formulation of concentration inequality that is introduced into a robust adaptive windowing algorithm for multivariate data streams. The algorithm is used to obtain robust representation of segments with constant intestinal motility activity. The obtained sequential features are shown to be discriminative in the problem of abnormal motility characterization. Finally, we tackle the problem of efficient labeling. To this end, we incorporate active learning concepts to the problems present in WCE data and propose two approaches. The first one is based the concepts of sequential learning and the second one adapts the partition-based active learning to an error-free labeling scheme. All these steps are sufficient to provide an extensive visual description of intestinal motility that can be used by an expert as decision support system.

[1]  P. Jaccard,et al.  Etude comparative de la distribution florale dans une portion des Alpes et des Jura , 1901 .

[2]  A. Shimbel.  Structural parameters of communication networks , 1953 .

[3]  J. H. Ward.  Hierarchical Grouping to Optimize an Objective Function , 1963 .

[4]  W. Hoeffding.  Probability Inequalities for sums of Bounded Random Variables , 1963 .

[5]  Gert Sabidussi,et al.  The centrality index of a graph , 1966 .

[6]  B. Fleshler,et al.  Physiology of the Gastrointestinal Tract , 1969 .

[7]  Leonard M. Freeman,et al.  A set of measures of centrality based upon betweenness , 1977 .

[8]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[9]  Robert M. Haralick,et al.  Ridges and valleys on digital images , 1983, Comput. Vis. Graph. Image Process..

[10]  L. Johnson,et al.  Physiology of the gastrointestinal tract , 2012 .

[11]  F. Harary,et al.  Eccentricity and centrality in networks , 1995 .

[12]  Trevor C. Bailey,et al.  Interactive Spatial Data Analysis , 1995 .

[13]  E. Quigley,et al.  Gastric and small intestinal motility in health and disease. , 1996, Gastroenterology clinics of North America.

[14]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Andrew McCallum,et al.  Employing EM and Pool-Based Active Learning for Text Classification , 1998, ICML.

[16]  J. C. BurgesChristopher.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998 .

[17]  Piotr Indyk,et al.  Similarity Search in High Dimensions via Hashing , 1999, VLDB.

[18]  Vladimir Vapnik,et al.  An overview of statistical learning theory , 1999, IEEE Trans. Neural Networks.

[19]  P. Massart.  Some applications of concentration inequalities to statistics , 2000 .

[20]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[21]  黄亚明.  MedScape , 2009 .

[22]  Daphne Koller,et al.  Support Vector Machine Active Learning with Applications to Text Classification , 2000, J. Mach. Learn. Res..

[23]  U. Brandes.  A faster algorithm for betweenness centrality , 2001 .

[24]  Koby Crammer,et al.  On the Algorithmic Implementation of Multiclass Kernel-based Vector Machines , 2002, J. Mach. Learn. Res..

[25]  Piotr Indyk,et al.  Maintaining Stream Statistics over Sliding Windows , 2002, SIAM J. Comput..

[26]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  J. Lafferty,et al.  Combining active learning and semi-supervised learning using Gaussian fields and harmonic functions , 2003, ICML 2003.

[29]  Jitendra Malik,et al.  Learning a classification model for segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[30]  Xiaowei Xu,et al.  Representative Sampling for Text Classification Using Support Vector Machines , 2003, ECIR.

[31]  H. Sebastian Seung,et al.  Selective Sampling Using the Query by Committee Algorithm , 1997, Machine Learning.

[32]  Arnold W. M. Smeulders,et al.  Active learning using pre-clustering , 2004, ICML.

[33]  David A. Cohn,et al.  Improving generalization with active learning , 1994, Machine Learning.

[34]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[35]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[36]  Thomas Hofmann,et al.  Large Margin Methods for Structured and Interdependent Output Variables , 2005, J. Mach. Learn. Res..

[37]  R. Sagawa,et al.  A diagnosis support system for capsule endoscopy , 2007, Inflammopharmacology.

[38]  Fernando Vilariño,et al.  Linear Radial Patterns Characterization for Automatic Detection of Tonic Intestinal Contractions , 2006, CIARP.

[39]  Hinrich Schütze,et al.  Performance thresholding in practical text classification , 2006, CIKM '06.

[40]  Fernando Vilariño,et al.  Anisotropic Feature Extraction from Endoluminal Images for Detection of Intestinal Contractions , 2006, MICCAI.

[41]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[42]  Yasushi Yagi,et al.  Adaptive Control of Video Display for Diagnostic Assistance by Analysis of Capsule Endoscopic Images , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[43]  Fernando Vilariño,et al.  Automatic Detection of Intestinal Juices in Wireless Capsule Video Endoscopy , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[44]  Csaba Szepesvári,et al.  Tuning Bandit Algorithms in Stochastic Environments , 2007, ALT.

[45]  Yasushi Yagi,et al.  Contraction Detection in Small Bowel from an Image Sequence of Wireless Capsule Endoscopy , 2007, MICCAI.

[46]  Jung-Hwan Oh,et al.  Automatic classification of digestive organs in wireless capsule endoscopy videos , 2007, SAC '07.

[47]  C. O'Morain,et al.  15th United European Gastroenterology Week , 2007, Expert Review of Gastroenterology & Hepatology.

[48]  Paul N. Bennett,et al.  Dual Strategy Active Learning , 2007, ECML.

[49]  Robert C. Holte,et al.  Decision Tree Instability and Active Learning , 2007, ECML.

[50]  Ricard Gavaldà,et al.  Learning from Time-Changing Data with Adaptive Windowing , 2007, SDM.

[51]  Barbara Caputo,et al.  The projectron: a bounded kernel-based Perceptron , 2008, ICML '08.

[52]  Sanjoy Dasgupta,et al.  Hierarchical sampling for active learning , 2008, ICML '08.

[53]  Miguel Tavares Coimbra,et al.  Automated Topographic Segmentation and Transit Time Estimation in Endoscopic Capsule Exams , 2008, IEEE Transactions on Medical Imaging.

[54]  Mark H. Fisher,et al.  Bleeding detection in wireless capsule endoscopy using adaptive colour histogram model and support vector classification , 2008, SPIE Medical Imaging.

[55]  Jong Hyo Kim,et al.  Active Blood Detection in a High Resolution Capsule Endoscopy using Color Spectrum Transformation , 2008, 2008 International Conference on BioMedical Engineering and Informatics.

[56]  Subhransu Maji,et al.  Classification using intersection kernel support vector machines is efficient , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[57]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[58]  P. Dario,et al.  Recent Patents on Wireless Capsule Endoscopy , 2008 .

[59]  Max Q.-H. Meng,et al.  Computer-based detection of bleeding and ulcer in wireless capsule endoscopy images by chromaticity moments , 2009, Comput. Biol. Medicine.

[60]  Y. Metzger,et al.  Comparison of a new PillCam™ SB2 video capsule versus the standard PillCam™ SB for detection of small bowel disease , 2009 .

[61]  Max Q.-H. Meng,et al.  Small bowel tumor detection for wireless capsule endoscopy images using textural features and support vector machine , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[62]  Fernando Vilariño,et al.  Automatic Discrimination of Duodenum in Wireless Capsule Video Endoscopy , 2009 .

[63]  Thomas Hofmann,et al.  Predicting structured objects with support vector machines , 2009, Commun. ACM.

[64]  Yasushi Yagi,et al.  Detection of contractions in adaptive transit time of the small bowel from wireless capsule endoscopy videos , 2009, Comput. Biol. Medicine.

[65]  John Langford,et al.  Agnostic active learning , 2006, J. Comput. Syst. Sci..

[66]  Yasushi Yagi,et al.  Evaluating the control of the adaptive display rate for video capsule endoscopy diagnosis , 2009, 2008 IEEE International Conference on Robotics and Biomimetics.

[67]  Ram D. Sriram,et al.  A model of deformable rings for interpretation of wireless capsule endoscopic videos , 2006, Medical Image Anal..

[68]  Anton Dries,et al.  Adaptive concept drift detection , 2009, SDM.

[69]  Albert Bifet,et al.  Adaptive learning and mining for data streams and frequent patterns , 2009, SKDD.

[70]  Cesare Alippi,et al.  Change detection tests using the ICI rule , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[71]  Fernando Vilariño,et al.  Intestinal Motility Assessment With Video Capsule Endoscopy: Automatic Annotation of Phasic Intestinal Contractions , 2010, IEEE Transactions on Medical Imaging.

[72]  Edward J. Ciaccio,et al.  Distinguishing patients with celiac disease by quantitative analysis of videocapsule endoscopy images , 2010, Comput. Methods Programs Biomed..

[73]  Yoshito Mekada,et al.  Automatic detection of informative frames from wireless capsule endoscopy images , 2010, Medical Image Anal..

[74]  Y. Tsai,et al.  Automatic detection and segmentation of colonic polyps in wireless capsule images , 2010 .

[75]  A. Uhl,et al.  Computer-Aided Decision Support Systems for Endoscopy in the Gastrointestinal Tract: A Review , 2011, IEEE Reviews in Biomedical Engineering.

[76]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[77]  Ramin Zabih,et al.  Dynamic Programming and Graph Algorithms in Computer Vision , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[78]  Nikolaos G. Bourbakis,et al.  Detection of Small Bowel Polyps and Ulcers in Wireless Capsule Endoscopy Videos , 2011, IEEE Transactions on Biomedical Engineering.

[79]  Richard Szeliski,et al.  Computer Vision - Algorithms and Applications , 2011, Texts in Computer Science.

[80]  Michal Mackiewicz.  Capsule Endoscopy - State of the Technology and Computer Vision Tools After the First Decade , 2011 .

[81]  Max Q.-H. Meng,et al.  Polyp detection in wireless capsule endoscopy images using novel color texture features , 2011, 2011 9th World Congress on Intelligent Control and Automation.

[82]  João Gama,et al.  A survey on learning from data streams: current and future trends , 2012, Progress in Artificial Intelligence.

[83]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[84]  Fernando Azpiroz,et al.  Determinants of gastric emptying and transit in the small intestine , 2011 .

[85]  Sanjoy Dasgupta,et al.  Two faces of active learning , 2011, Theor. Comput. Sci..

[86]  Jordi Vitrià,et al.  Interactive Labeling of WCE Images , 2011, IbPRIA.

[87]  Jordi Vitrià,et al.  Active labeling: Application to wireless endoscopy analysis , 2012, 2012 International Conference on High Performance Computing & Simulation (HPCS).

[88]  Jian-Huang Lai,et al.  Ulcer detection in wireless capsule endoscopy images , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[89]  Gregory D. Hager,et al.  Assessment of Crohn’s Disease Lesions in Wireless Capsule Endoscopy Images , 2012, IEEE Transactions on Biomedical Engineering.

[90]  Ludmila I. Kuncheva,et al.  Change Detection in Streaming Multivariate Data Using Likelihood Detectors , 2013, IEEE Transactions on Knowledge and Data Engineering.

[91]  Tao Xiang,et al.  Finding Rare Classes: Active Learning with Generative and Discriminative Models , 2013, IEEE Transactions on Knowledge and Data Engineering.