Deep learning based image classification for intestinal hemorrhage

Convolutional neural networks (CNN) have become a popular choice for image segmentation and classification. Internal body images are obscure in nature with involvement of noise, luminance variation, rotation and blur. Thus optimal choice of features for machine learning model to classify bleeding is still an open problem. CNN is efficient for attribute selection and ensemble learning makes a generalized robust system. Capsule endoscopy is a new technology which enables a gastroenterologist to visualize the entire digestive tract including small bowel to diagnose bleeding, ulcer and polyp. This paper presents a supervised learning ensemble to detect the bleeding in the images of Wireless Capsule Endoscopy. It accurately finds out the best possible combination of attributes required to classify bleeding symptoms in endoscopy images. A careful setting for CNN layer options and optimizer for back propagation after reducing the color palette using minimum variance quantization has shown promising results. Results of testing on public and real dataset has been analyzed. Proposed ensemble is able to achieve 0.95 on the public endoscopy dataset and 0.93 accuracy on the real video dataset. A detailed data analysis has also been incorporated in the study including RGB pixel intensities, distributions of binary classes and various class ratios for training.

[1]  Nader Karimi,et al.  Low Complexity CNN Structure for Automatic Bleeding Zone Detection in Wireless Capsule Endoscopy Imaging , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[2]  Yong Man Ro,et al.  Modality-bridge transfer learning for medical image classification , 2017, 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI).

[3]  S. T. Devarakonda,et al.  A convolutional neural network approach for abnormality detection in Wireless Capsule Endoscopy , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[4]  Amro Najjar,et al.  Explanations of Black-Box Model Predictions by Contextual Importance and Utility , 2019, EXTRAAMAS@AAMAS.

[5]  Nader Karimi,et al.  Segmentation of Bleeding Regions in Wireless Capsule Endoscopy Images an Approach for inside Capsule Video Summarization , 2018, ArXiv.

[6]  D. Rex,et al.  Performance of given suspected blood indicator , 2003, American Journal of Gastroenterology.

[7]  Soo Young Shin,et al.  Detection of small colon bleeding in wireless capsule endoscopy videos , 2016, Comput. Medical Imaging Graph..

[8]  Bing Zeng,et al.  Review on the Applications of Deep Learning in the Analysis of Gastrointestinal Endoscopy Images , 2019, IEEE Access.

[9]  A. Robert Calderbank,et al.  Performance Bounds for Expander-Based Compressed Sensing in Poisson Noise , 2010, IEEE Transactions on Signal Processing.

[10]  Yi Xiong,et al.  Bleeding detection in wireless capsule endoscopy based on MST clustering and SVM , 2015, 2015 IEEE Workshop on Signal Processing Systems (SiPS).

[11]  Guozheng Yan,et al.  Bleeding Detection in Wireless Capsule Endoscopy Based on Probabilistic Neural Network , 2011, Journal of Medical Systems.

[12]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[13]  Max Q.-H. Meng,et al.  Computer-Aided Detection of Bleeding Regions for Capsule Endoscopy Images , 2009, IEEE Transactions on Biomedical Engineering.

[14]  Dong Ni,et al.  Deep Learning in Medical Ultrasound Analysis: A Review , 2019, Engineering.

[15]  Jacob Chakareski,et al.  Effective Deep Learning for Semantic Segmentation Based Bleeding Zone Detection in Capsule Endoscopy Images , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[16]  Yanchun Zhang,et al.  Multi-Stage Attention-Unet for Wireless Capsule Endoscopy Image Bleeding Area Segmentation , 2019, 2019 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[17]  Hao Liu,et al.  Exploring transfer learning for gastrointestinal bleeding detection on small-size imbalanced endoscopy images , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[18]  Venkatesan Rajinikanth,et al.  Deep Learning for Medical Image Processing , 2020 .

[19]  Yixuan Yuan,et al.  Deep learning for polyp recognition in wireless capsule endoscopy images , 2017, Medical physics.

[20]  Bill Buckles,et al.  Bleeding detection from capsule endoscopy videos , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[21]  Zhiming Luo,et al.  An Ensemble Deep Learning Method for Vehicle Type Classification on Visual Traffic Surveillance Sensors , 2017, IEEE Access.

[22]  Jianguo Liu,et al.  Obscure bleeding detection in endoscopy images using support vector machines , 2009 .

[23]  F. Carpi,et al.  Grand challenges in magnetic capsule endoscopy , 2013, Expert review of medical devices.

[24]  Jordi Vitrià,et al.  Generic Feature Learning for Wireless Capsule Endoscopy Analysis , 2016, Comput. Biol. Medicine.

[25]  Yang Lu,et al.  Identification of rice diseases using deep convolutional neural networks , 2017, Neurocomputing.

[26]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[27]  Giorgos Tolias,et al.  Fine-Tuning CNN Image Retrieval with No Human Annotation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Kary Främling,et al.  Explaining Machine Learning-Based Classifications of In-Vivo Gastral Images , 2019, 2019 Digital Image Computing: Techniques and Applications (DICTA).

[29]  Sanjit K. Mitra,et al.  An Algorithm for Fast Segmentation of Color Images , 1999 .

[30]  D. Iakovidis,et al.  Software for enhanced video capsule endoscopy: challenges for essential progress , 2015, Nature Reviews Gastroenterology &Hepatology.

[31]  Mohamed Abouelenien,et al.  Cluster-based Sampling and Ensemble for Bleeding Detection in Capsule Endoscopy Videos , 2013 .

[32]  Ting Liu,et al.  Recent advances in convolutional neural networks , 2015, Pattern Recognit..

[33]  Fei Gao,et al.  Convolutional neural networks for intestinal hemorrhage detection in wireless capsule endoscopy images , 2017, 2017 IEEE International Conference on Multimedia and Expo (ICME).

[34]  Luis Perez,et al.  The Effectiveness of Data Augmentation in Image Classification using Deep Learning , 2017, ArXiv.

[35]  Xiaohan Xing,et al.  Bleeding Detection in Wireless Capsule Endoscopy Image Video Using Superpixel-Color Histogram and a Subspace KNN Classifier , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[36]  Ah Chung Tsoi,et al.  Face recognition: a convolutional neural-network approach , 1997, IEEE Trans. Neural Networks.

[37]  Max Q.-H. Meng,et al.  Gastrointestinal bleeding detection in wireless capsule endoscopy images using handcrafted and CNN features , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[38]  Max Q.-H. Meng,et al.  A deep convolutional neural network for bleeding detection in Wireless Capsule Endoscopy images , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[39]  Sunil Kumar,et al.  Computer-assisted bleeding detection in wireless capsule endoscopy images , 2013, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[40]  José Rubén,et al.  Deep learning in hierarchical neural networks applied as pattern classifiers for massive information systems , 2018 .

[41]  Khan A. Wahid,et al.  Automated Bleeding Detection in Capsule Endoscopy Videos Using Statistical Features and Region Growing , 2014, Journal of Medical Systems.

[42]  Justin Salamon,et al.  Deep Convolutional Neural Networks and Data Augmentation for Environmental Sound Classification , 2016, IEEE Signal Processing Letters.

[43]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[44]  Husanbir Singh Pannu,et al.  A Systematic Review on Imbalanced Data Challenges in Machine Learning , 2019, ACM Comput. Surv..

[45]  Argentina Leite,et al.  A Deep Learning Approach for Red Lesions Detection in Video Capsule Endoscopies , 2018, ICIAR.

[46]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[47]  Muhammad Imran Razzak,et al.  Deep Learning for Medical Image Processing: Overview, Challenges and Future , 2017, ArXiv.

[48]  Yanpeng Li,et al.  Improving deep neural networks using softplus units , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).