An Advanced Deep Learning Approach for Ki-67 Stained Hotspot Detection and Proliferation Rate Scoring for Prognostic Evaluation of Breast Cancer

Being a non-histone protein, Ki-67 is one of the essential biomarkers for the immunohistochemical assessment of proliferation rate in breast cancer screening and grading. The Ki-67 signature is always sensitive to radiotherapy and chemotherapy. Due to random morphological, color and intensity variations of cell nuclei (immunopositive and immunonegative), manual/subjective assessment of Ki-67 scoring is error-prone and time-consuming. Hence, several machine learning approaches have been reported; nevertheless, none of them had worked on deep learning based hotspots detection and proliferation scoring. In this article, we suggest an advanced deep learning model for computerized recognition of candidate hotspots and subsequent proliferation rate scoring by quantifying Ki-67 appearance in breast cancer immunohistochemical images. Unlike existing Ki-67 scoring techniques, our methodology uses Gamma mixture model (GMM) with Expectation-Maximization for seed point detection and patch selection and deep learning, comprises with decision layer, for hotspots detection and proliferation scoring. Experimental results provide 93% precision, 0.88% recall and 0.91% F-score value. The model performance has also been compared with the pathologists’ manual annotations and recently published articles. In future, the proposed deep learning framework will be highly reliable and beneficial to the junior and senior pathologists for fast and efficient Ki-67 scoring.

[1]  Johannes Gerdes,et al.  Production of a mouse monoclonal antibody reactive with a human nuclear antigen associated with cell proliferation , 1983, International journal of cancer.

[2]  H Stein,et al.  Cell cycle analysis of a cell proliferation-associated human nuclear antigen defined by the monoclonal antibody Ki-67. , 1984, Journal of immunology.

[3]  P. gordon,et al.  Determination of proliferative activity in colorectal carcinoma using monoclonal antibody Ki67 , 1997, Diseases of the colon and rectum.

[4]  A. Thor,et al.  Comparison of mitotic index, in vitro bromodeoxyuridine labeling, and MIB-1 assays to quantitate proliferation in breast cancer. , 1999, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[5]  H. S. Shukla,et al.  Predictive markers of response to neoadjuvant chemotherapy in breast cancer. , 2008, Surgical oncology.

[6]  S. Osowski,et al.  New automated image analysis method for the assessment of Ki-67 labeling index in meningiomas. , 2010, Folia histochemica et cytobiologica.

[7]  Sven Behnke,et al.  Evaluation of Pooling Operations in Convolutional Architectures for Object Recognition , 2010, ICANN.

[8]  Vilppu J Tuominen,et al.  ImmunoRatio: a publicly available web application for quantitative image analysis of estrogen receptor (ER), progesterone receptor (PR), and Ki-67 , 2010, Breast Cancer Research.

[9]  Luca Maria Gambardella,et al.  Max-pooling convolutional neural networks for vision-based hand gesture recognition , 2011, 2011 IEEE International Conference on Signal and Image Processing Applications (ICSIPA).

[10]  Mikael Lundin,et al.  Development and evaluation of a virtual microscopy application for automated assessment of Ki-67 expression in breast cancer , 2011, BMC clinical pathology.

[11]  M. Becich,et al.  Immunohistochemical staining of radixin and moesin in prostatic adenocarcinoma , 2011, BMC clinical pathology.

[12]  Quan Wang,et al.  GMM-Based Hidden Markov Random Field for Color Image and 3D Volume Segmentation , 2012, ArXiv.

[13]  Vipin Chaudhary,et al.  Automating proliferation rate estimation from Ki-67 histology images , 2012, Medical Imaging.

[14]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[15]  D C McMillan,et al.  Comparison of Visual and automated assessment of Ki-67 proliferative activity and their impact on outcome in primary operable invasive ductal breast cancer , 2012, British Journal of Cancer.

[16]  Hui Kong,et al.  Automated detection of cells from immunohistochemically-stained tissues: application to Ki-67 nuclei staining , 2012, Medical Imaging.

[17]  Nasir M. Rajpoot,et al.  A gamma-gaussian mixture model for detection of mitotic cells in breast cancer histopathology images , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[18]  Tara N. Sainath,et al.  Improving deep neural networks for LVCSR using rectified linear units and dropout , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[19]  T. V. van Gulik,et al.  Accurate Quantitation of Ki67-positive Proliferating Hepatocytes in Rabbit Liver by a Multicolor Immunohistochemical (IHC) Approach Analyzed with Automated Tissue and Cell Segmentation Software , 2013, The journal of histochemistry and cytochemistry : official journal of the Histochemistry Society.

[20]  Hai Su,et al.  An Integrated Framework for Automatic Ki-67 Scoring in Pancreatic Neuroendocrine Tumor , 2013, MICCAI.

[21]  Arvydas Laurinavicius,et al.  A methodology to ensure and improve accuracy of Ki67 labelling index estimation by automated digital image analysis in breast cancer tissue , 2014, Breast Cancer Research.

[22]  Hai Su,et al.  Automatic Ki-67 Counting Using Robust Cell Detection and Online Dictionary Learning , 2014, IEEE Transactions on Biomedical Engineering.

[23]  Catherine Bor-Angelier,et al.  Building of a composite virtual slide from contiguous tissue samples , 2014, Diagnostic Pathology.

[24]  Mårten Fernö,et al.  A novel model for Ki67 assessment in breast cancer , 2014, Diagnostic Pathology.

[25]  Xiaoping Zhou,et al.  Perceptual clustering for automatic hotspot detection from Ki‐67‐stained neuroendocrine tumour images , 2014, Journal of microscopy.

[26]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[27]  Yan Xu,et al.  Deep learning of feature representation with multiple instance learning for medical image analysis , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[28]  Carsten Denkert,et al.  Standardized Ki67 Diagnostics Using Automated Scoring—Clinical Validation in the GeparTrio Breast Cancer Study , 2014, Clinical Cancer Research.

[29]  D. Zaha,et al.  Significance of immunohistochemistry in breast cancer. , 2014, World journal of clinical oncology.

[30]  Zaneta Swiderska,et al.  Hot-spot selection and evaluation methods for whole slice images of meningiomas and oligodendrogliomas , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[31]  Peter Kontschieder,et al.  Deep Neural Decision Forests , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[32]  Malgorzata Lorent,et al.  Comparison of the Manual, Semiautomatic, and Automatic Selection and Leveling of Hot Spots in Whole Slide Images for Ki-67 Quantification in Meningiomas , 2015, Analytical cellular pathology.

[33]  C. Mathers,et al.  Cancer incidence and mortality worldwide: Sources, methods and major patterns in GLOBOCAN 2012 , 2015, International journal of cancer.

[34]  Pabitra Mitra,et al.  Histogram Based Thresholding for Automated Nucleus Segmentation Using Breast Imprint Cytology , 2015 .

[35]  Alex Zhavoronkov,et al.  Applications of Deep Learning in Biomedicine. , 2016, Molecular pharmaceutics.

[36]  Peter Devilee,et al.  High‐throughput automated scoring of Ki67 in breast cancer tissue microarrays from the Breast Cancer Association Consortium , 2016, The journal of pathology. Clinical research.

[37]  Chandan Chakraborty,et al.  Quantitative microscopic evaluation of mucin areas and its percentage in mucinous carcinoma of the breast using tissue histological images. , 2016, Tissue & cell.

[38]  Nasir M. Rajpoot,et al.  Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images , 2016, IEEE Trans. Medical Imaging.

[39]  Jianzhong Wu,et al.  Stacked Sparse Autoencoder (SSAE) for Nuclei Detection on Breast Cancer Histopathology Images , 2016, IEEE Transactions on Medical Imaging.

[40]  Lin Yang,et al.  An Automatic Learning-Based Framework for Robust Nucleus Segmentation , 2016, IEEE Transactions on Medical Imaging.

[41]  C. Chakraborty,et al.  Computer-aided diagnosis of breast cancer using cytological images: A systematic review. , 2016, Tissue & cell.

[42]  R. Shui,et al.  A Comparison of Visual Assessment and Automated Digital Image Analysis of Ki67 Labeling Index in Breast Cancer , 2016, PloS one.

[43]  Yun-bin Chen,et al.  Automated Ki-67 Quantification of Immunohistochemical Staining Image of Human Nasopharyngeal Carcinoma Xenografts , 2016, Scientific Reports.