Automatic evaluation of degree of cleanliness in capsule endoscopy based on a novel CNN architecture

Capsule endoscopy (CE) is a widely used, minimally invasive alternative to traditional endoscopy that allows visualisation of the entire small intestine. Patient preparation can help to obtain a cleaner intestine and thus better visibility in the resulting videos. However, studies on the most effective preparation method are conflicting due to the absence of objective, automatic cleanliness evaluation methods. In this work, we aim to provide such a method capable of presenting results on an intuitive scale, with a relatively light-weight novel convolutional neural network architecture at its core. We trained our model using 5-fold cross-validation on an extensive data set of over 50,000 image patches, collected from 35 different CE procedures, and compared it with state-of-the-art classification methods. From the patch classification results, we developed a method to automatically estimate pixel-level probabilities and deduce cleanliness evaluation scores through automatically learnt thresholds. We then validated our method in a clinical setting on 30 newly collected CE videos, comparing the resulting scores to those independently assigned by human specialists. We obtained the highest classification accuracy for the proposed method (95.23%), with significantly lower average prediction times than for the second-best method. In the validation of our method, we found acceptable agreement with two human specialists compared to interhuman agreement, showing its validity as an objective evaluation method.

[1]  Yoshito Mekada,et al.  Detecting Informative Frames from Wireless Capsule Endoscopic Video Using Color and Texture Features , 2008, MICCAI.

[2]  Valery Naranjo,et al.  Automatic Detection of Intestinal Content to Evaluate Visibility in Capsule Endoscopy , 2019, 2019 13th International Symposium on Medical Information and Communication Technology (ISMICT).

[3]  M. Warrens Conditional inequalities between Cohen's kappa and weighted kappas , 2013 .

[4]  Thomas Brox,et al.  Striving for Simplicity: The All Convolutional Net , 2014, ICLR.

[5]  Paul F. Whelan,et al.  Deep Learning in Texture Analysis and Its Application to Tissue Image Classification , 2017 .

[6]  G. Ahlenstiel,et al.  Validated computed cleansing score for video capsule endoscopy , 2016, Digestive endoscopy : official journal of the Japan Gastroenterological Endoscopy Society.

[7]  Nan Li,et al.  Reduction of bubble-like frames using a RSS filter in wireless capsule endoscopy video , 2019, Optics & Laser Technology.

[8]  Zhang Zhuo,et al.  Feature selection and classification for Wireless Capsule Endoscopic frames , 2009, 2009 International Conference on Biomedical and Pharmaceutical Engineering.

[9]  Paul J. Werbos,et al.  Backpropagation Through Time: What It Does and How to Do It , 1990, Proc. IEEE.

[10]  M. Muñoz-Navas,et al.  Evaluation of Different Bowel Preparations for Small Bowel Capsule Endoscopy: A Prospective, Randomized, Controlled Study , 2011, Digestive Diseases and Sciences.

[11]  M. Muñoz-Navas,et al.  Intestinal preparation prior to capsule endoscopy administration. , 2008, World journal of gastroenterology.

[12]  Weihong Deng,et al.  Very deep convolutional neural network based image classification using small training sample size , 2015, 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR).

[13]  Max Q.-H. Meng,et al.  Removal of non-informative frames for wireless capsule endoscopy video segmentation , 2012, 2012 IEEE International Conference on Automation and Logistics.

[14]  Terry K Koo,et al.  A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. , 2016, Journal Chiropractic Medicine.

[15]  Max Q.-H. Meng,et al.  A deep convolutional neural network for bleeding detection in Wireless Capsule Endoscopy images , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[16]  Fernando Vilariño,et al.  Categorization and Segmentation of Intestinal Content Frames for Wireless Capsule Endoscopy , 2012, IEEE Transactions on Information Technology in Biomedicine.

[17]  Jacob Cohen,et al.  Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. , 1968 .

[18]  J. Sim,et al.  The kappa statistic in reliability studies: use, interpretation, and sample size requirements. , 2005, Physical therapy.

[19]  H. Soltanian-Zadeh,et al.  Informati ve and Uninformative Regions Detection in WCE Frames , 2014 .

[20]  Elli Angelopoulou,et al.  Automatic Region-of-Interest Segmentation and Pathology Detection in Magnetically Guided Capsule Endoscopy , 2011, MICCAI.

[21]  Fernando Vilariño,et al.  Automatic Detection of Intestinal Juices in Wireless Capsule Video Endoscopy , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[22]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.