Mitotic nuclei analysis in breast cancer histopathology images using deep ensemble classifier

Mitotic nuclei estimation in breast tumour samples has a prognostic significance in analysing tumour aggressiveness and grading system. The automated assessment of mitotic nuclei is challenging because of their high similarity with non-mitotic nuclei and heteromorphic appearance. In this work, we have proposed a new Deep Convolutional Neural Network (CNN) based Heterogeneous Ensemble technique "DHE-Mit-Classifier" for analysis of mitotic nuclei in breast histopathology images. The proposed technique in the first step detects candidate mitotic patches from the histopathological biopsy regions, whereas, in the second step, these patches are classified into mitotic and non-mitotic nuclei using the proposed DHE-Mit-Classifier. For the development of a heterogeneous ensemble, five different deep CNNs are designed and used as base-classifiers. These deep CNNs have varying architectural designs to capture the structural, textural, and morphological properties of the mitotic nuclei. The developed base-classifiers exploit different ideas, including (i) region homogeneity and feature invariance, (ii) asymmetric split-transform-merge, (iii) dilated convolution based multi-scale transformation, (iv) spatial and channel attention, and (v) residual learning. Multi-layer-perceptron is used as a meta-classifier to develop a robust and accurate classifier for providing the final decision. The performance of the proposed ensemble "DHE-Mit-Classifier" is evaluated against state-of-the-art CNNs. The performance evaluation on the test set suggests the superiority of the proposed ensemble with an F-score (0.77), recall (0.71), precision (0.83), and area under the precision-recall curve (0.80). The good generalisation of the proposed ensemble with a considerably high F-score and precision suggests its potential use in the development of an assistance tool for pathologists.

[1]  Wenyu Liu,et al.  DeepMitosis: Mitosis detection via deep detection, verification and segmentation networks , 2018, Medical Image Anal..

[2]  Limin Luo,et al.  ELNet: Automatic classification and segmentation for esophageal lesions using convolutional neural network , 2020, Medical Image Anal..

[3]  Simon M Thomas,et al.  Interpretable deep learning systems for multi-class segmentation and classification of non-melanoma skin cancer , 2020, Medical Image Anal..

[4]  M. Veta,et al.  Are pathologist-defined labels reproducible? Comparison of the TUPAC16 mitotic figure dataset with an alternative set of labels , 2020, iMIMIC/MIL3iD/LABELS@MICCAI.

[5]  Nikos Komodakis,et al.  Wide Residual Networks , 2016, BMVC.

[6]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Asifullah Khan,et al.  A survey of the recent architectures of deep convolutional neural networks , 2019, Artificial Intelligence Review.

[8]  J. Nortier,et al.  The prognostic relevance of the mitotic activity index in axillary lymph node-negative breast cancer , 2014, Breast Cancer Research and Treatment.

[9]  Angel Cruz-Roa,et al.  Mitosis detection in breast cancer pathology images by combining handcrafted and convolutional neural network features , 2014, Journal of medical imaging.

[10]  Asifullah Khan,et al.  Two-phase deep convolutional neural network for reducing class skewness in histopathological images based breast cancer detection , 2017, Comput. Biol. Medicine.

[11]  A. Jemal,et al.  Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries , 2018, CA: a cancer journal for clinicians.

[12]  In-So Kweon,et al.  CBAM: Convolutional Block Attention Module , 2018, ECCV.

[13]  Nico Karssemeijer,et al.  Using deep convolutional neural networks to identify and classify tumor-associated stroma in diagnostic breast biopsies , 2018, Modern Pathology.

[14]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Asifullah Khan,et al.  Channel Boosted Convolutional Neural Network for Classification of Mitotic Nuclei using Histopathological Images , 2020, 2020 17th International Bhurban Conference on Applied Sciences and Technology (IBCAST).

[16]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[17]  Mitko Veta,et al.  Mitosis Counting in Breast Cancer: Object-Level Interobserver Agreement and Comparison to an Automatic Method , 2016, PloS one.

[18]  Yen-Wei Chen,et al.  A Cascade of 2.5D CNN and Bidirectional CLSTM Network for Mitotic Cell Detection in 4D Microscopy Image , 2019, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[19]  David Gutman,et al.  An Ensemble-based Active Learning for Breast Cancer Classification , 2019, 2019 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[20]  J. Elmore,et al.  Diagnostic concordance among pathologists interpreting breast biopsy specimens. , 2015, JAMA.

[21]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Min Beom Lee,et al.  Artificial Intelligence-Based Mitosis Detection in Breast Cancer Histopathology Images Using Faster R-CNN and Deep CNNs , 2020, Journal of clinical medicine.

[23]  Lior Rokach,et al.  Ensemble learning: A survey , 2018, WIREs Data Mining Knowl. Discov..

[24]  Bo Wang,et al.  Weakly supervised mitosis detection in breast histopathology images using concentric loss , 2019, Medical Image Anal..

[25]  Yongming Li,et al.  Automatic cell nuclei segmentation and classification of breast cancer histopathology images , 2016, Signal Process..

[26]  Remco Duits,et al.  Roto-Translation Equivariant Convolutional Networks: Application to Histopathology Image Analysis , 2020, Medical Image Anal..

[27]  Jean Paul Barddal,et al.  A Survey on Ensemble Learning for Data Stream Classification , 2017, ACM Comput. Surv..

[28]  J. S. Marron,et al.  A method for normalizing histology slides for quantitative analysis , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[29]  J. Baak,et al.  Prognostic value of proliferation in invasive breast cancer: a review , 2004, Journal of Clinical Pathology.

[30]  Nasir M. Rajpoot,et al.  Leveraging Unlabeled Whole-Slide-Images for Mitosis Detection , 2018, COMPAY/OMIA@MICCAI.

[31]  Chen Li,et al.  An Application of Transfer Learning and Ensemble Learning Techniques for Cervical Histopathology Image Classification , 2020, IEEE Access.

[32]  MERIEM SEBAI,et al.  PartMitosis: A Partially Supervised Deep Learning Framework for Mitosis Detection in Breast Cancer Histopathology Images , 2020, IEEE Access.

[33]  Xujuan Zhou,et al.  A new nested ensemble technique for automated diagnosis of breast cancer , 2020, Pattern Recognit. Lett..

[34]  F M Moore,et al.  Mitotic Count and the Field of View Area , 2016, Veterinary pathology.

[35]  Haijun Lei,et al.  Attention-Guided Multi-Branch Convolutional Neural Network for Mitosis Detection From Histopathological Images , 2020, IEEE Journal of Biomedical and Health Informatics.

[36]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Asifullah Khan,et al.  Multifaceted fused-CNN based scoring of breast cancer whole-slide histopathology images , 2020, Appl. Soft Comput..

[38]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[39]  Minsoo Kim,et al.  A Unified Framework for Tumor Proliferation Score Prediction in Breast Histopathology , 2016, DLMIA/ML-CDS@MICCAI.

[40]  Atsuto Maki,et al.  A systematic study of the class imbalance problem in convolutional neural networks , 2017, Neural Networks.

[41]  Anselmo Cardoso de Paiva,et al.  Breast cancer diagnosis from histopathological images using textural features and CBIR , 2020, Artif. Intell. Medicine.

[42]  Jianhui Chen,et al.  Automated grading of breast cancer histopathology using cascaded ensemble with combination of multi-level image features , 2017, Neurocomputing.

[43]  Vijayan K. Asari,et al.  MitosisNet: End-to-End Mitotic Cell Detection by Multi-Task Learning , 2020, IEEE Access.

[44]  Asifullah Khan,et al.  A multi-phase deep CNN based mitosis detection framework for breast cancer histopathological images , 2021, Scientific Reports.

[45]  Maria S. Kulikova,et al.  Mitosis detection in breast cancer histological images An ICPR 2012 contest , 2013, Journal of pathology informatics.

[46]  Steve Halligan,et al.  Disadvantages of using the area under the receiver operating characteristic curve to assess imaging tests: A discussion and proposal for an alternative approach , 2015, European Radiology.

[47]  Asifullah Khan,et al.  Transfer learning based deep CNN for segmentation and detection of mitoses in breast cancer histopathological images. , 2019, Microscopy.