Capsule endoscopy video segmentation by spectral clustering

Capsule endoscopy is a new imaging technology for small intestine due to its breakthrough for direct visualization of small intestine for the first time. However, the video data produced for each patient costs a physician much time to inspect. Aiming for reducing the burden of a physician, video scene analysis is indispensable. In this paper, we propose a new video segmentation method to analyze a CE video data since video segmentation is the first step in video scene analysis. A novel color textural feature is utilized to describe the content of the frame in a CE video, then spectral clustering method is applied to segment a CE video into meaningful parts via shot boundary detection. Preliminary experiments on ten short CE videos demonstrate a promising performance of the proposed scheme.

[1]  Baopu Li,et al.  A study on computer-aided diagnosis for wireless capsule endoscopy images , 2008 .

[2]  Max Q.-H. Meng,et al.  Computer-based detection of bleeding and ulcer in wireless capsule endoscopy images by chromaticity moments , 2009, Comput. Biol. Medicine.

[3]  Byeong-Seok Shin,et al.  Reducing redundancy in wireless capsule endoscopy videos , 2013, Comput. Biol. Medicine.

[4]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Sae Hwang,et al.  Polyp detection in Wireless Capsule Endoscopy videos based on image segmentation and geometric feature , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[6]  Max Q.-H. Meng,et al.  Capsule endoscopy video Boundary Detection , 2011, 2011 IEEE International Conference on Information and Automation.

[7]  Jiawei Han,et al.  Spectral Clustering , 2018, Data Clustering: Algorithms and Applications.

[8]  Bill P. Buckles,et al.  Wireless Capsule Endoscopy Video Segmentation Using an Unsupervised Learning Approach Based on Probabilistic Latent Semantic Analysis With Scale Invariant Features , 2012, IEEE Transactions on Information Technology in Biomedicine.

[9]  Michal Mackiewicz,et al.  Wireless Capsule Endoscopy Color Video Segmentation , 2008, IEEE Transactions on Medical Imaging.

[10]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[11]  Gregory D. Hager,et al.  Assessment of Crohn’s Disease Lesions in Wireless Capsule Endoscopy Images , 2012, IEEE Transactions on Biomedical Engineering.

[12]  Miguel Tavares Coimbra,et al.  Automated Topographic Segmentation and Transit Time Estimation in Endoscopic Capsule Exams , 2008, IEEE Transactions on Medical Imaging.

[13]  P. Swain,et al.  Wireless capsule endoscopy. , 2002, The Israel Medical Association journal : IMAJ.

[14]  Yong Man Ro,et al.  Local Color Vector Binary Patterns From Multichannel Face Images for Face Recognition , 2012, IEEE Transactions on Image Processing.

[15]  Max Q.-H. Meng,et al.  Comparison of several image features for WCE video abstract , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Akio Nagasaka,et al.  Automatic Video Indexing and Full-Video Search for Object Appearances , 1991, VDB.

[17]  Max Q.-H. Meng,et al.  Wireless capsule endoscopy video automatic segmentation , 2012, 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[18]  Dimitrios K. Iakovidis,et al.  Reduction of capsule endoscopy reading times by unsupervised image mining , 2010, Comput. Medical Imaging Graph..

[19]  M Pennazio,et al.  Capsule endoscopy: where are we after 6 years of clinical use? , 2006, Digestive and liver disease : official journal of the Italian Society of Gastroenterology and the Italian Association for the Study of the Liver.

[20]  Max Q.-H. Meng,et al.  Computer-Aided Detection of Bleeding Regions for Capsule Endoscopy Images , 2009, IEEE Transactions on Biomedical Engineering.

[21]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Max Q.-H. Meng,et al.  Texture analysis for ulcer detection in capsule endoscopy images , 2009, Image Vis. Comput..

[23]  Boon-Lock Yeo,et al.  Rapid scene analysis on compressed video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[24]  Joo-Hwee Lim,et al.  Epitomized Summarization of Wireless Capsule Endoscopic Videos for Efficient Visualization , 2010, MICCAI.