Deep Learning for Identifying Metastatic Breast Cancer

The International Symposium on Biomedical Imaging (ISBI) held a grand challenge to evaluate computational systems for the automated detection of metastatic breast cancer in whole slide images of sentinel lymph node biopsies. Our team won both competitions in the grand challenge, obtaining an area under the receiver operating curve (AUC) of 0.925 for the task of whole slide image classification and a score of 0.7051 for the tumor localization task. A pathologist independently reviewed the same images, obtaining a whole slide image classification AUC of 0.966 and a tumor localization score of 0.733. Combining our deep learning system's predictions with the human pathologist's diagnoses increased the pathologist's AUC to 0.995, representing an approximately 85 percent reduction in human error rate. These results demonstrate the power of using deep learning to produce significant improvements in the accuracy of pathological diagnoses.

[1]  E. Ackerknecht RUDOLF VIRCHOW: DOCTOR, STATESMAN, ANTHROPOLOGIST , 1954 .

[2]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[3]  P. Anthony Robbins' Pathologic Basis of Disease , 1990 .

[4]  E. Conant,et al.  Immunohistochemistry with pancytokeratins improves the sensitivity of sentinel lymph node biopsy in patients with breast carcinoma , 1999, Cancer.

[5]  D. Weaver,et al.  Comparison of Pathologist-Detected and Automated Computer-Assisted Image Analysis Detected Sentinel Lymph Node Micrometastases in Breast Cancer , 2003, Modern Pathology.

[6]  F. Meier,et al.  Clinical impact and frequency of anatomic pathology errors in cancer diagnoses , 2005, Cancer.

[7]  E. Winer,et al.  American Society of Clinical Oncology guideline recommendations for sentinel lymph node biopsy in early-stage breast cancer. , 2005, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[8]  Raouf E Nakhleh,et al.  Error reduction in surgical pathology. , 2009, Archives of pathology & laboratory medicine.

[9]  S. Raab,et al.  Clinical impact and frequency of anatomic pathology errors in cancer diagnoses , 2005, Cancer.

[10]  G. Chejfec Robbins Pathologic Basis of Disease , 2009 .

[11]  A. Madabhushi,et al.  Histopathological Image Analysis: A Review , 2009, IEEE Reviews in Biomedical Engineering.

[12]  C. Compton,et al.  The American Joint Committee on Cancer: the 7th Edition of the AJCC Cancer Staging Manual and the Future of TNM , 2010, Annals of Surgical Oncology.

[13]  Andrew H. Beck,et al.  Systematic Analysis of Breast Cancer Morphology Uncovers Stromal Features Associated with Survival , 2011, Science Translational Medicine.

[14]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[15]  Andrew Evans,et al.  Digital imaging in pathology: whole-slide imaging and beyond. , 2013, Annual review of pathology.

[16]  Luca Maria Gambardella,et al.  Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks , 2013, MICCAI.

[17]  H. Irshad,et al.  Methods for Nuclei Detection, Segmentation, and Classification in Digital Histopathology: A Review—Current Status and Future Potential , 2014, IEEE Reviews in Biomedical Engineering.

[18]  S. Jaffer,et al.  Evolution of Sentinel Lymph Node Biopsy in Breast Cancer, In and Out of Vogue? , 2014, Advances in anatomic pathology.

[19]  S. Edge,et al.  Sentinel lymph node biopsy for patients with early-stage breast cancer: American Society of Clinical Oncology clinical practice guideline update. , 2014, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[20]  Anil K. Jain,et al.  Face Search at Scale: 80 Million Gallery , 2015, ArXiv.

[21]  Mbbs Md FRCPath Donald N. Pritzker Vinay Kumar Robbins and Cotran pathologic basis of disease , 2015 .

[22]  J. Elmore,et al.  Diagnostic concordance among pathologists interpreting breast biopsy specimens. , 2015, JAMA.

[23]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[25]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.