Two Ensemble-CNN Approaches for Colorectal Cancer Tissue Type Classification

In recent years, automatic tissue phenotyping has attracted increasing interest in the Digital Pathology (DP) field. For Colorectal Cancer (CRC), tissue phenotyping can diagnose the cancer and differentiate between different cancer grades. The development of Whole Slide Images (WSIs) has provided the required data for creating automatic tissue phenotyping systems. In this paper, we study different hand-crafted feature-based and deep learning methods using two popular multi-classes CRC-tissue-type databases: Kather-CRC-2016 and CRC-TP. For the hand-crafted features, we use two texture descriptors (LPQ and BSIF) and their combination. In addition, two classifiers are used (SVM and NN) to classify the texture features into distinct CRC tissue types. For the deep learning methods, we evaluate four Convolutional Neural Network (CNN) architectures (ResNet-101, ResNeXt-50, Inception-v3, and DenseNet-161). Moreover, we propose two Ensemble CNN approaches: Mean-Ensemble-CNN and NN-Ensemble-CNN. The experimental results show that the proposed approaches outperformed the hand-crafted feature-based methods, CNN architectures and the state-of-the-art methods in both databases.

[1]  K. Polyak,et al.  Intra-tumour heterogeneity: a looking glass for cancer? , 2012, Nature Reviews Cancer.

[2]  Naoufel Werghi,et al.  Multiplex Cellular Communities in Multi-Gigapixel Colorectal Cancer Histology Images for Tissue Phenotyping , 2020, IEEE Transactions on Image Processing.

[3]  Ville Ojansivu,et al.  Blur Insensitive Texture Classification Using Local Phase Quantization , 2008, ICISP.

[4]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Constantino Carlos Reyes-Aldasoro,et al.  Predicting survival from colorectal cancer histology slides using deep learning: A retrospective multicenter study , 2019, PLoS medicine.

[6]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Ewa Szczurek,et al.  ARA: accurate, reliable and active histopathological image classification framework with Bayesian deep learning , 2019, Scientific Reports.

[8]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[9]  Fadi Dornaika,et al.  Fusion of transformed shallow features for facial expression recognition , 2019, IET Image Process..

[10]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[11]  A. Jemal,et al.  Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries , 2018, CA: a cancer journal for clinicians.

[12]  Tahsin Kurc,et al.  Twenty Years of Digital Pathology: An Overview of the Road Travelled, What is on the Horizon, and the Emergence of Vendor-Neutral Archives , 2018, Journal of pathology informatics.

[13]  H. Ueno,et al.  A Comparison of Methods for Studying the Tumor Microenvironment's Spatial Heterogeneity in Digital Pathology Specimens , 2021, Journal of pathology informatics.

[14]  Yang Xie,et al.  Artificial Intelligence in Lung Cancer Pathology Image Analysis , 2019, Cancers.

[15]  Lin Chen,et al.  Age Classification Using Convolutional Neural Networks with the Multi-class Focal Loss , 2018, IOP Conference Series: Materials Science and Engineering.

[16]  Matti Pietikäinen,et al.  Identification of tumor epithelium and stroma in tissue microarrays using texture analysis , 2012, Diagnostic Pathology.

[17]  M. L. Fravolini,et al.  Dimensionality Reduction Strategies for CNN-Based Classification of Histopathological Images , 2018, IIMSS.

[18]  B F Warren,et al.  The proportion of tumor-stroma as a strong prognosticator for stage II and III colon cancer patients: validation in the VICTOR trial. , 2013, Annals of oncology : official journal of the European Society for Medical Oncology.

[19]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Navid Farahani,et al.  whole slide imaging in pathology: advantages, limitations, and emerging perspectives , 2015 .

[21]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[22]  Z. Werb,et al.  Tumors as organs: complex tissues that interface with the entire organism. , 2010, Developmental cell.

[23]  Esa Rahtu,et al.  BSIF: Binarized statistical image features , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[24]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Fadi Dornaika,et al.  Multi-label, multi-task CNN approach for context-based emotion recognition , 2020, Inf. Fusion.

[26]  David B. A. Epstein,et al.  Cellular community detection for tissue phenotyping in colorectal cancer histology images , 2020, Medical Image Anal..

[27]  Nico Karssemeijer,et al.  Using deep convolutional neural networks to identify and classify tumor-associated stroma in diagnostic breast biopsies , 2018, Modern Pathology.

[28]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  May D. Wang,et al.  Histological image classification using biologically interpretable shape-based features , 2013, BMC Medical Imaging.

[30]  Francesco Bianconi,et al.  Multi-class texture analysis in colorectal cancer histology , 2016, Scientific Reports.

[31]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[32]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[33]  Abdelmalik Taleb-Ahmed,et al.  Deep learning for real-time semantic segmentation: Application in ultrasound imaging , 2021, Pattern Recognit. Lett..

[34]  Hong Liu,et al.  Classification of Tumor Epithelium and Stroma by Exploiting Image Features Learned by Deep Convolutional Neural Networks , 2018, Annals of Biomedical Engineering.

[35]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Loris Nanni,et al.  Bioimage Classification with Handcrafted and Learned Features , 2019, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[37]  Francesco Bianconi,et al.  Discrimination between tumour epithelium and stroma via perception-based features , 2015, Neurocomputing.

[38]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[39]  David B. A. Epstein,et al.  Novel digital signatures of tissue phenotypes for predicting distant metastasis in colorectal cancer , 2018, Scientific Reports.