MCUa: Multi-Level Context and Uncertainty Aware Dynamic Deep Ensemble for Breast Cancer Histology Image Classification

Breast histology image classification is a crucial step in the early diagnosis of breast cancer. In breast pathological diagnosis, Convolutional Neural Networks (CNNs) have demonstrated great success using digitized histology slides. However, tissue classification is still challenging due to the high visual variability of the large-sized digitized samples and the lack of contextual information. In this paper, we propose a novel CNN, called Multi-level Context and Uncertainty aware (MCUa) dynamic deep learning ensemble model. MCUa model consists of several multi-level context-aware models to learn the spatial dependency between image patches in a layer-wise fashion. It exploits the high sensitivity to the multi-level contextual information using an uncertainty quantification component to accomplish a novel dynamic ensemble model. MCUa model has achieved a high accuracy of 98.11% on a breast cancer histology image dataset. Experimental results show the superior effectiveness of the proposed solution compared to the state-of-the-art histology classification models.

[1]  Heesung Kwon,et al.  Going Deeper With Contextual CNN for Hyperspectral Image Classification , 2016, IEEE Transactions on Image Processing.

[2]  Linda G. Shapiro,et al.  Y-Net: Joint Segmentation and Classification for Diagnosis of Breast Biopsy Images , 2018, MICCAI.

[3]  Catarina Eloy,et al.  Classification of breast cancer histology images using Convolutional Neural Networks , 2017, PloS one.

[4]  Ismaël Koné,et al.  Hierarchical ResNeXt Models for Breast Cancer Histology Image Classification , 2018, ICIAR.

[5]  Nasir M. Rajpoot,et al.  Context-Aware Learning using Transferable Features for Classification of Breast Cancer Histology Images , 2018, ICIAR.

[6]  Chong Wang,et al.  Attention to Lesion: Lesion-Aware Convolutional Neural Network for Retinal Optical Coherence Tomography Image Classification , 2019, IEEE Transactions on Medical Imaging.

[7]  Hao Chen,et al.  MILD‐Net: Minimal information loss dilated network for gland instance segmentation in colon histology images , 2018, Medical Image Anal..

[8]  Qitao Huang,et al.  Weakly Supervised Deep Learning for Whole Slide Lung Cancer Image Analysis , 2020, IEEE Transactions on Cybernetics.

[9]  Rafael García,et al.  Geostatistics for Context-Aware Image Classification , 2015, ICVS.

[10]  Kaiqi Huang,et al.  Learning Deep Context-Aware Features over Body and Latent Parts for Person Re-identification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Nikolaos Doulamis,et al.  Deep supervised learning for hyperspectral data classification through convolutional neural networks , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[12]  Mehran Ebrahimi,et al.  Two-Stage Convolutional Neural Network for Breast Cancer Histology Image Classification , 2018, ICIAR.

[13]  M. Plummer,et al.  International agency for research on cancer. , 2020, Archives of pathology.

[14]  Yanning Zhang,et al.  EMS-Net: Ensemble of Multiscale Convolutional Neural Networks for Classification of Breast Cancer Histology Images , 2019, Neurocomputing.

[15]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Adrien Depeursinge,et al.  Automated classification of brain tumor type in whole-slide digital pathology images using local representative tiles , 2016, Medical Image Anal..

[17]  Ronnachai Jaroensri,et al.  Artificial intelligence in digital breast pathology: Techniques and applications , 2019, Breast.

[18]  Li Wang,et al.  Learning Multiviewpoint Context-Aware Representation for RGB-D Scene Classification , 2018, IEEE Signal Processing Letters.

[19]  Ghassan Hamarneh,et al.  A structured latent model for ovarian carcinoma subtyping from histopathology slides , 2017, Medical Image Anal..

[20]  Xiaoqin Wang,et al.  Improved Trainable Calibration Method for Neural Networks on Medical Imaging Classification , 2020, ArXiv.

[21]  Aleksey Boyko,et al.  Detecting Cancer Metastases on Gigapixel Pathology Images , 2017, ArXiv.

[22]  Xilin Chen,et al.  IAUnet: Global Context-Aware Feature Learning for Person Reidentification , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[23]  Ewa Szczurek,et al.  ARA: accurate, reliable and active histopathological image classification framework with Bayesian deep learning , 2019, Scientific Reports.

[24]  Zoubin Ghahramani,et al.  Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning , 2015, ICML.

[25]  Mohamed Medhat Gaber,et al.  3E-Net: Entropy-Based Elastic Ensemble of Deep Convolutional Neural Networks for Grading of Invasive Breast Carcinoma Histopathological Microscopic Images , 2021, Entropy.

[26]  Wei Li,et al.  Diverse Region-Based CNN for Hyperspectral Image Classification , 2018, IEEE Transactions on Image Processing.

[27]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[28]  Yongxiang Huang,et al.  Improving High Resolution Histology Image Classification with Deep Spatial Fusion Network , 2018, COMPAY/OMIA@MICCAI.

[29]  Alex Varghese,et al.  Classification of Breast Cancer Histology Image using Ensemble of Pre-trained Neural Networks , 2018, ICIAR.

[30]  Fa Zhang,et al.  Breast cancer histopathological image classification using a hybrid deep neural network. , 2020, Methods.

[31]  Kamyar Nazeri,et al.  Two-Stage Convolutional Neural Network for Breast Cancer Histology Image Classification , 2018 .

[32]  Geoffrey E. Hinton,et al.  Dynamic Routing Between Capsules , 2017, NIPS.

[33]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[34]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Yuhua Jiang,et al.  Automatic Diagnosis Based on Spatial Information Fusion Feature for Intracranial Aneurysm , 2020, IEEE Transactions on Medical Imaging.

[36]  Aryan Mobiny,et al.  Risk-Aware Machine Learning Classifier for Skin Lesion Diagnosis , 2019, Journal of clinical medicine.

[37]  N. M. Rajpoot,et al.  FABnet: feature attention-based network for simultaneous segmentation of microvessels and nerves in routine histology images of oral cancer , 2019, Neural Computing and Applications.

[38]  Luiz Eduardo Soares de Oliveira,et al.  A Dataset for Breast Cancer Histopathological Image Classification , 2016, IEEE Transactions on Biomedical Engineering.

[39]  J P Vink,et al.  Efficient nucleus detector in histopathology images , 2013, Journal of microscopy.

[40]  Li Liu,et al.  A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challenges , 2020, Inf. Fusion.

[41]  Dorit Merhof,et al.  Multi Scale Curriculum CNN for Context-Aware Breast MRI Malignancy Classification , 2019, MICCAI.

[42]  Nico Karssemeijer,et al.  Context-aware stacked convolutional neural networks for classification of breast carcinomas in whole-slide histopathology images , 2017, Journal of medical imaging.

[43]  Maximilian Baust,et al.  Assessment of Breast Cancer Histology using Densely Connected Convolutional Networks , 2018, ICIAR.

[44]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[45]  J. S. Marron,et al.  A method for normalizing histology slides for quantitative analysis , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[46]  Catarina Eloy,et al.  BACH: Grand Challenge on Breast Cancer Histology Images , 2018, Medical Image Anal..