Machine Learning-Based Classification of the Health State of Mice Colon in Cancer Study from Confocal Laser Endomicroscopy

In this article, we address the problem of the classification of the health state of the colon’s wall of mice, possibly injured by cancer with machine learning approaches. This problem is essential for translational research on cancer and is a priori challenging since the amount of data is usually limited in all preclinical studies for practical and ethical reasons. Three states considered including cancer, health, and inflammatory on tissues. Fully automated machine learning-based methods are proposed, including deep learning, transfer learning, and shallow learning with SVM. These methods addressed different training strategies corresponding to clinical questions such as the automatic clinical state prediction on unseen data using a pre-trained model, or in an alternative setting, real-time estimation of the clinical state of individual tissue samples during the examination. Experimental results show the best performance of 99.93% correct recognition rate obtained for the second strategy as well as the performance of 98.49% which were achieved for the more difficult first case.

[1]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[2]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[3]  David Rousseau,et al.  Transfer Learning from Synthetic Data Applied to Soil-Root Segmentation in X-Ray Tomography Images , 2018, J. Imaging.

[4]  M. Neurath,et al.  Confocal Laser Endomicroscopy for In Vivo Diagnosis of Clostridium difficile Associated Colitis — A Pilot Study , 2013, PloS one.

[5]  A. Saftoiu,et al.  Computer Aided Diagnosis for Confocal Laser Endomicroscopy in Advanced Colorectal Adenocarcinoma , 2016, PloS one.

[6]  David Rousseau,et al.  Robust graph representation of images with underlying structural networks. Application to the classification of vascular networks of mice's colon , 2017, Pattern Recognit. Lett..

[7]  H. Saint-Jalmes,et al.  Endoluminal high-resolution MR imaging protocol for colon walls analysis in mouse model of colitis , 2018 .

[8]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Francesco S. Pavone,et al.  Multiphoton morpho-functional imaging of healthy colon mucosa, adenomatous polyp and adenocarcinoma , 2013, Biomedical optics express.

[10]  J. Izatt,et al.  Quantitative laser scanning confocal autofluorescence microscopy of normal, premalignant, and malignant colonic tissues , 1999, IEEE Transactions on Biomedical Engineering.

[11]  Fei Wang,et al.  Predictive Modeling of the Hospital Readmission Risk from Patients’ Claims Data Using Machine Learning: A Case Study on COPD , 2019, Scientific Reports.

[12]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[13]  Jung-Hwan Oh,et al.  Informative frame classification for endoscopy video , 2007, Medical Image Anal..

[14]  Loris Nanni,et al.  Survey on LBP based texture descriptors for image classification , 2012, Expert Syst. Appl..

[15]  M. Neurath,et al.  High resolution colonoscopy in live mice , 2006, Nature Protocols.

[16]  Guang-Zhong Yang,et al.  Deep Learning for Health Informatics , 2017, IEEE Journal of Biomedical and Health Informatics.

[17]  Yong Fan,et al.  A deep learning model integrating FCNNs and CRFs for brain tumor segmentation , 2017, Medical Image Anal..

[18]  Lisa Mielke,et al.  Confocal laser endomicroscopy to monitor the colonic mucosa of mice , 2015, Journal of immunological methods.

[19]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Jing Liu,et al.  Learning Curve and Interobserver Agreement of Confocal Laser Endomicroscopy for Detecting Precancerous or Early-Stage Esophageal Squamous Cancer , 2014, PloS one.

[21]  Stefan Wirtz,et al.  Confocal laser endomicroscopy and narrow-band imaging-aided endoscopy for in vivo imaging of colitis and colon cancer in mice , 2011, Nature Protocols.

[22]  Martin Goetz,et al.  Confocal Laser Endomicroscopy for Diagnosis and Histomorphologic Imaging of Brain Tumors In Vivo , 2012, PloS one.

[23]  Hao Chen,et al.  Gland segmentation in colon histology images: The glas challenge contest , 2016, Medical Image Anal..

[24]  Dorin Comaniciu,et al.  Cascaded deep decision networks for classification of endoscopic images , 2017, Medical Imaging.

[25]  John E. Reid,et al.  Machine learning based classification of cells into chronological stages using single-cell transcriptomics , 2018, Scientific Reports.

[26]  Victor S. Lempitsky,et al.  Unsupervised Domain Adaptation by Backpropagation , 2014, ICML.

[27]  Leonid Karlinsky,et al.  A Region Based Convolutional Network for Tumor Detection and Classification in Breast Mammography , 2016, LABELS/DLMIA@MICCAI.

[28]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Andrew Zisserman,et al.  Incremental learning of object detectors using a visual shape alphabet , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[30]  Eithne Costello,et al.  From mice to men: Murine models of colorectal cancer for use in translational research. , 2016, Critical reviews in oncology/hematology.

[31]  Guang-Zhong Yang,et al.  A Hand-held Instrument to Maintain Steady Tissue Contact during Probe-Based Confocal Laser Endomicroscopy , 2011, IEEE Transactions on Biomedical Engineering.

[32]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[33]  V. Konda,et al.  In Vivo Assessment of Tumor Vascularity Using Confocal Laser Endomicroscopy in Murine Models of Colon Cancer , 2013 .

[34]  Yoshito Mekada,et al.  Automatic detection of informative frames from wireless capsule endoscopy images , 2010, Medical Image Anal..

[35]  Ralph Highnam,et al.  Oncological image analysis , 2016, Medical Image Anal..

[36]  Kyoung-Sae Na Prediction of future cognitive impairment among the community elderly: A machine-learning based approach , 2019, Scientific Reports.

[37]  Loris Nanni,et al.  Local binary patterns variants as texture descriptors for medical image analysis , 2010, Artif. Intell. Medicine.

[38]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[39]  Tammy Riklin-Raviv,et al.  De-noising of Contrast-Enhanced MRI Sequences by an Ensemble of Expert Deep Neural Networks , 2016, LABELS/DLMIA@MICCAI.

[40]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[41]  Juho Kannala,et al.  Cell Segmentation Proposal Network for Microscopy Image Analysis , 2016, LABELS/DLMIA@MICCAI.