A convolutional neural network approach for abnormality detection in Wireless Capsule Endoscopy

In wireless capsule endoscopy (WCE), a swallowable miniature optical endoscope is used to transmit color images of the gastrointestinal tract. However, the number of images transmitted is large, taking a significant amount of the medical expert's time to review the scan. In this paper, we propose a technique to automate the abnormality detection in WCE images. We split the image into several patches and extract features pertaining to each block using a convolutional neural network (CNN) to increase their generality while overcoming the drawbacks of manually crafted features. We intend to exploit the importance of color information for the task. Experiments are performed to determine the optimal color space components for feature extraction and classifier design. We obtained an area under receiver-operating-characteristic (ROC) curve of approximately 0.8 on a dataset containing multiple abnormalities.

[1]  Byunghan Lee,et al.  Deep learning in bioinformatics , 2016, Briefings Bioinform..

[2]  Anastasios Koulaouzidis,et al.  Blood detection in wireless capsule endoscope images based on salient superpixels , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[3]  Dimitris K. Iakovidis,et al.  Automatic lesion detection in capsule endoscopy based on color saliency: closer to an essential adjunct for reviewing software. , 2014, Gastrointestinal endoscopy.

[4]  Anastasios Koulaouzidis,et al.  Automatic lesion detection in wireless capsule endoscopy — A simple solution for a complex problem , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[5]  Artur Klepaczko,et al.  Texture and color based image segmentation and pathology detection in capsule endoscopy videos , 2014, Comput. Methods Programs Biomed..

[6]  李抱朴,et al.  Automatic polyp detection for wireless capsule endoscopy images , 2012 .

[7]  Guozheng Yan,et al.  Bleeding detection in wireless capsule endoscopy images based on color invariants and spatial pyramids using support vector machines , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[8]  Nikolaos G. Bourbakis,et al.  Detection of Small Bowel Polyps and Ulcers in Wireless Capsule Endoscopy Videos , 2011, IEEE Transactions on Biomedical Engineering.

[9]  Dimitrios K. Iakovidis,et al.  Reduction of capsule endoscopy reading times by unsupervised image mining , 2010, Comput. Medical Imaging Graph..

[10]  Max Q.-H. Meng,et al.  Texture analysis for ulcer detection in capsule endoscopy images , 2009, Image Vis. Comput..

[11]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[12]  Dimitris A. Karras,et al.  Detection of lesions in endoscopic video using textural descriptors on wavelet domain supported by artificial neural network architectures , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[13]  P. Swain,et al.  Wireless capsule endoscopy. , 2002, The Israel Medical Association journal : IMAJ.