Proliferation Tumour Marker Network (PTM-NET) for the identification of tumour region in Ki67 stained breast cancer whole slide images

Uncontrolled proliferation is a hallmark of cancer and can be assessed by labelling breast tissue using immunohistochemistry for Ki67, a protein associated with cell proliferation. Accurate measurement of Ki67-positive tumour nuclei is of critical importance, but requires annotation of the tumour regions by a pathologist. This manual annotation process is highly subjective, time-consuming and subject to inter- and intra-annotator experience. To address this challenge, we have developed Proliferation Tumour Marker Network (PTM-NET), a deep learning model that objectively annotates the tumour regions in Ki67-labelled breast cancer digital pathology images using a convolution neural network. Our custom designed deep learning model was trained on 45 immunohistochemical Ki67-labelled whole slide images to classify tumour and non-tumour regions and was validated on 45 whole slide images from two different sources that were stained using different protocols. Our results show a Dice coefficient of 0.74, positive predictive value of 70% and negative predictive value of 88.3% against the manual ground truth annotation for the combined dataset. There were minimal differences between the images from different sources and the model was further tested in oestrogen receptor and progesterone receptor-labelled images. Finally, using an extension of the model, we could identify possible hotspot regions of high proliferation within the tumour. In the future, this approach could be useful in identifying tumour regions in biopsy samples and tissue microarray images.

[1]  B. A. Carter,et al.  Assessment of Ki67 in Breast Cancer: Recommendations from the International Ki67 in Breast Cancer Working Group , 2012 .

[2]  Nico Karssemeijer,et al.  Deep learning-based assessment of tumor-associated stroma for diagnosing breast cancer in histopathology images , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[3]  Pierre-Marie Martin,et al.  Ki-67: level of evidence and methodological considerations for its role in the clinical management of breast cancer: analytical and critical review , 2011, Breast Cancer Research and Treatment.

[4]  Anant Madabhushi,et al.  A Deep Convolutional Neural Network for segmenting and classifying epithelial and stromal regions in histopathological images , 2016, Neurocomputing.

[5]  R. C. Macridis A review , 1963 .

[6]  Mike Hale,et al.  Quantification of histochemical stains using whole slide imaging: development of a method and demonstration of its usefulness in laboratory quality control , 2014, Journal of Clinical Pathology.

[7]  Arvydas Laurinavicius,et al.  A methodology to ensure and improve accuracy of Ki67 labelling index estimation by automated digital image analysis in breast cancer tissue , 2014, Breast Cancer Research.

[8]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[9]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[10]  B. van Ginneken,et al.  Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis , 2016, Scientific Reports.

[11]  C. Mathers,et al.  Cancer incidence and mortality worldwide: Sources, methods and major patterns in GLOBOCAN 2012 , 2015, International journal of cancer.

[12]  Päivi Heikkilä,et al.  Performance of automated scoring of ER, PR, HER2, CK5/6 and EGFR in breast cancer tissue microarrays in the Breast Cancer Association Consortium , 2014, The journal of pathology. Clinical research.

[13]  Shan-e-Ahmed Raza,et al.  DeepSDCS: Dissecting cancer proliferation heterogeneity in Ki67 digital whole slide images , 2018, ArXiv.

[14]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  P. Fasching,et al.  Primary Therapy of Patients with Early Breast Cancer: Evidence, Controversies, Consensus , 2015, Geburtshilfe und Frauenheilkunde.

[16]  Chaoyang Zhang,et al.  Deep Learning Based Analysis of Histopathological Images of Breast Cancer , 2019, Front. Genet..

[17]  Jesper Molin,et al.  Implementation of large-scale routine diagnostics using whole slide imaging in Sweden: Digital pathology experiences 2006-2013 , 2014, Journal of pathology informatics.

[18]  Matti Pietikäinen,et al.  Identification of tumor epithelium and stroma in tissue microarrays using texture analysis , 2012, Diagnostic Pathology.

[19]  Jack Cuzick,et al.  Assessment of Ki67 in breast cancer: recommendations from the International Ki67 in Breast Cancer working group. , 2011, Journal of the National Cancer Institute.

[20]  J. Baak,et al.  Prognostic value of proliferation in invasive breast cancer: a review , 2004, Journal of Clinical Pathology.

[21]  Abien Fred Agarap Deep Learning using Rectified Linear Units (ReLU) , 2018, ArXiv.

[22]  Mitch Dowsett,et al.  Prognostic value of Ki67 expression after short-term presurgical endocrine therapy for primary breast cancer. , 2007, Journal of the National Cancer Institute.

[23]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[24]  Anant Madabhushi,et al.  Accurate and reproducible invasive breast cancer detection in whole-slide images: A Deep Learning approach for quantifying tumor extent , 2017, Scientific Reports.

[25]  Vittorio Murino,et al.  Excitation Dropout: Encouraging Plasticity in Deep Neural Networks , 2018, ArXiv.

[26]  Yee-Wah Tsang,et al.  Validation of digital pathology imaging for primary histopathological diagnosis , 2016, Histopathology.

[27]  N. Rajpoot,et al.  Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images , 2016, IEEE Transactions on Medical Imaging.

[28]  M. Labelle,et al.  Molecular classification of infiltrating breast cancer: toward personalized therapy. , 2014, Radiographics : a review publication of the Radiological Society of North America, Inc.

[29]  Nasir M. Rajpoot,et al.  Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images , 2016, IEEE Trans. Medical Imaging.

[30]  I. Ellis,et al.  Pathological prognostic factors in breast cancer. I. The value of histological grade in breast cancer: experience from a large study with long-term follow-up. , 2002, Histopathology.

[31]  C. Chakraborty,et al.  An Advanced Deep Learning Approach for Ki-67 Stained Hotspot Detection and Proliferation Rate Scoring for Prognostic Evaluation of Breast Cancer , 2017, Scientific Reports.