A general framework for wireless capsule endoscopy study synopsis

We present a general framework for analysis of wireless capsule endoscopy (CE) studies. The current available workstations provide a time-consuming and labor-intense work-flow for clinicians which requires the inspection of the full-length video. The development of a computer-aided diagnosis (CAD) CE workstation will have a great potential to reduce the diagnostic time and improve the accuracy of assessment. We propose a general framework based on hidden Markov models (HMMs) for study synopsis that forms the computational engine of our CAD workstation. Color, edge and texture features are first extracted and analyzed by a Support Vector Machine classifier, and then encoded as the observations for the HMM, uniquely combining the temporal information during the assessment. Experiments were performed on 13 full-length CE studies, instead of selected images previously reported. The results (e.g. 0.933 accuracy with 0.933 recall for detection of polyps) show that our framework achieved promising performance for multiple classification. We also report the patient-level CAD assessment of complete CE studies for multiple abnormalities, and the patient-level validation demonstrates the effectiveness and robustness of our methods.

[1]  Gregory D. Hager,et al.  Assessment of Crohn’s Disease Lesions in Wireless Capsule Endoscopy Images , 2012, IEEE Transactions on Biomedical Engineering.

[2]  Liyuan Li,et al.  Multi-level local feature classification for bleeding detection in Wireless Capsule Endoscopy images , 2010, 2010 IEEE Conference on Cybernetics and Intelligent Systems.

[3]  John S. Boreczky,et al.  A hidden Markov model framework for video segmentation using audio and image features , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[4]  Yoshito Mekada,et al.  Detecting Informative Frames from Wireless Capsule Endoscopic Video Using Color and Texture Features , 2008, MICCAI.

[5]  Phooi Yee Lau,et al.  Detection of bleeding patterns in WCE video using multiple features , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[6]  Fernando Vilariño,et al.  Intestinal Motility Assessment With Video Capsule Endoscopy: Automatic Annotation of Phasic Intestinal Contractions , 2010, IEEE Transactions on Medical Imaging.

[7]  B. S. Manjunath,et al.  Color and texture descriptors , 2001, IEEE Trans. Circuits Syst. Video Technol..

[8]  Miguel Tavares Coimbra,et al.  Automated Topographic Segmentation and Transit Time Estimation in Endoscopic Capsule Exams , 2008, IEEE Transactions on Medical Imaging.

[9]  Gregory D. Hager,et al.  Learning disease severity for capsule endoscopy images , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[10]  Evaggelos Spyrou,et al.  Efficient homography-based video visualization for wireless capsule endoscopy , 2013, 13th IEEE International Conference on BioInformatics and BioEngineering.

[11]  Gregory D. Hager,et al.  Analysis of Crohn's disease lesions in capsule endoscopy images , 2009, 2009 IEEE International Conference on Robotics and Automation.

[12]  Max Q.-H. Meng,et al.  A Decision Fusion Strategy for Polyp Detection in Capsule Endoscopy , 2012, MMVR.

[13]  P. Swain,et al.  Wireless capsule endoscopy. , 2002, The Israel Medical Association journal : IMAJ.

[14]  Hong Liu,et al.  Wireless Capsule Endoscopy Video Reduction Based on Camera Motion Estimation , 2013, Journal of Digital Imaging.

[15]  Max Q.-H. Meng,et al.  A strategy to abstract WCE video clips based on LDA , 2011, 2011 IEEE International Conference on Robotics and Automation.

[16]  Gregory D. Hager,et al.  A Meta Method for Image Matching , 2011, IEEE Transactions on Medical Imaging.

[17]  Luís A. Alexandre,et al.  Color and Position versus Texture Features for Endoscopic Polyp Detection , 2008, 2008 International Conference on BioMedical Engineering and Informatics.

[18]  Rajesh Kumar,et al.  218 Towards Using Multiple Images Simultaneously for Automated Assessment in Capsule Endoscopy , 2012 .

[19]  Michal Mackiewicz,et al.  Wireless Capsule Endoscopy Color Video Segmentation , 2008, IEEE Transactions on Medical Imaging.

[20]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[21]  Yasushi Yagi,et al.  Adaptive Control of Video Display for Diagnostic Assistance by Analysis of Capsule Endoscopic Images , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[22]  Steven Yi,et al.  A clinically viable capsule endoscopy video analysis platform for automatic bleeding detection , 2013, Medical Imaging.

[23]  Chee Khun Poh,et al.  Vision-based techniques for efficient Wireless Capsule Endoscopy examination , 2011, 2011 Defense Science Research Conference and Expo (DSR).

[24]  Max Q.-H. Meng,et al.  WCE video clips segmentation based on abnormality , 2010, 2010 IEEE International Conference on Robotics and Biomimetics.

[25]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[26]  Gregory D. Hager,et al.  Towards integrating temporal information in capsule endoscopy image analysis , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[27]  Evaggelos Spyrou,et al.  Panoramic Visual Summaries for Efficient Reading of Capsule Endoscopy Videos , 2013, 2013 8th International Workshop on Semantic and Social Media Adaptation and Personalization.

[28]  Max Q.-H. Meng,et al.  Novel detection strategy for abnormalities in WCE video clips , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[29]  Van Nostrand,et al.  Error Bounds for Convolutional Codes and an Asymptotically Optimum Decoding Algorithm , 1967 .