Automated Scoring of Nuclear Pleomorphism Spectrum with Pathologist-level Performance in Breast Cancer

Nuclear pleomorphism is the degree of change in nuclear morphology, one of the components of the three-tiered breast cancer grading, along with tubular differentiation and mitotic counting. We consider the degree of nuclear pleomorphism as a continuum; a continuous spectrum of change in tumor morphology. We train a deep learning network on a large variety of tumor regions from the collective knowledge of several pathologists without constraining the network to the traditional three-category classification. We also motivate an additional approach in which we discuss the additional benefit of normal epithelium as baseline, following the routine clinical practice where pathologists are trained to score nuclear pleomorphism in tumor, having the normal breast epithelium as baseline. In multiple experiments, our fully-automated approach could achieve top pathologist-level performance in select regions of interest as well as at whole slide images, compared to ten and four pathologists, respectively.

[1]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[2]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[3]  Jeroen van der Laak,et al.  From Point Annotations to Epithelial Cell Detection in Breast Cancer Histopathology using RetinaNet , 2019 .

[4]  Nico Karssemeijer,et al.  Whole-Slide Mitosis Detection in H&E Breast Histology Using PHH3 as a Reference to Train Distilled Stain-Invariant Convolutional Networks , 2018, IEEE Transactions on Medical Imaging.

[5]  J. Russo,et al.  Breast carcinoma malignancy grading by Bloom–Richardson system vs proliferation index: reproducibility of grade and advantages of proliferation index , 2005, Modern Pathology.

[6]  S. Jaffer,et al.  Histologic Grading of Breast Carcinoma: A Multi-Institution Study of Interobserver Variation Using Virtual Microscopy , 2020, Modern Pathology.

[7]  A. Madabhushi,et al.  Automated Tubule Nuclei Quantification and Correlation with Oncotype DX risk categories in ER+ Breast Cancer Whole Slide Images , 2016, Scientific reports.

[8]  Luca Maria Gambardella,et al.  Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks , 2013, MICCAI.

[9]  Christophe Chefd'Hotel,et al.  Automatic glandular and tubule region segmentation in histological grading of breast cancer , 2015, Medical Imaging.

[10]  H. Bloom,et al.  Histological Grading and Prognosis in Breast Cancer , 1957, British Journal of Cancer.

[11]  I. Ellis,et al.  Pathological prognostic factors in breast cancer. I. The value of histological grade in breast cancer: experience from a large study with long-term follow-up. , 2002, Histopathology.

[12]  Shijian Lu,et al.  Detection of high-grade atypia nuclei in breast cancer imaging , 2015, Medical Imaging.

[13]  Ziba Gandomkar,et al.  Computer-Assisted Nuclear Atypia Scoring of Breast Cancer: a Preliminary Study , 2019, Journal of Digital Imaging.

[14]  D. L. Page Interobserver Agreement and Reproducibility in Classification of Invasive Breast Carcinoma: An NCI Breast Cancer Family Registry Study , 2007 .

[15]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Nasir M. Rajpoot,et al.  A Global Covariance Descriptor for Nuclear Atypia Scoring in Breast Histopathology Images , 2015, IEEE Journal of Biomedical and Health Informatics.

[17]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[18]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Ellery Wulczyn,et al.  Development and validation of a deep learning algorithm for improving Gleason scoring of prostate cancer , 2018, npj Digital Medicine.

[20]  Marc'Aurelio Ranzato,et al.  Building high-level features using large scale unsupervised learning , 2011, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[21]  Hanina Hibshoosh,et al.  Interobserver agreement and reproducibility in classification of invasive breast carcinoma: an NCI breast cancer family registry study , 2006, Modern Pathology.

[22]  Francesco Ciompi,et al.  Deep learning and manual assessment show that the absolute mitotic count does not contain prognostic information in triple negative breast cancer , 2019, Cellular Oncology.

[23]  M. Rantalainen,et al.  Artificial intelligence as the next step towards precision pathology , 2020, Journal of internal medicine.

[24]  M. McHugh Interrater reliability: the kappa statistic , 2012, Biochemia medica.

[25]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[26]  A. Madabhushi,et al.  Artificial intelligence in digital pathology — new tools for diagnosis and precision oncology , 2019, Nature Reviews Clinical Oncology.

[27]  Luca Maria Gambardella,et al.  Assessment of algorithms for mitosis detection in breast cancer histopathology images , 2014, Medical Image Anal..

[28]  Francesco Ciompi,et al.  Deep learning assisted mitotic counting for breast cancer , 2019, Laboratory Investigation.

[29]  Edward J. Delp,et al.  Tubule segmentation of fluorescence microscopy images based on convolutional neural networks with inhomogeneity correction , 2018, Computational Imaging.

[30]  B. van Ginneken,et al.  Automated deep-learning system for Gleason grading of prostate cancer using biopsies: a diagnostic study. , 2020, The Lancet. Oncology.

[31]  Karl Rohr,et al.  Predicting breast tumor proliferation from whole‐slide images: The TUPAC16 challenge , 2018, Medical Image Anal..

[32]  M. Gurcan,et al.  Digital pathology and artificial intelligence. , 2019, The Lancet. Oncology.

[33]  A. Jemal,et al.  Cancer statistics, 2020 , 2020, CA: a cancer journal for clinicians.

[34]  Robinson Thamburaj,et al.  Automated Nuclear Pleomorphism Scoring in Breast Cancer Histopathology Images Using Deep Neural Networks , 2015, MIKE.

[35]  Martin Eklund,et al.  Artificial intelligence assistance significantly improves Gleason grading of prostate biopsies by pathologists , 2020, Modern Pathology.

[36]  Zhen Ma,et al.  Automated image analysis of nuclear atypia in high‐power field histopathological image , 2015, Journal of microscopy.

[37]  M J Gaffey,et al.  Interobserver reproducibility of the Nottingham modification of the Bloom and Richardson histologic grading scheme for infiltrating ductal carcinoma. , 1995, American journal of clinical pathology.

[38]  Andrew H. Beck,et al.  Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer , 2017, JAMA.

[39]  Andrew Janowczyk,et al.  Deep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases , 2016, Journal of pathology informatics.

[40]  Geert J. S. Litjens,et al.  Quantifying the effects of data augmentation and stain color normalization in convolutional neural networks for computational pathology , 2019, Medical Image Anal..