Predicting Axillary Lymph Node Metastasis in Early Breast Cancer Using Deep Learning on Primary Tumor Biopsy Slides

Objectives To develop and validate a deep learning (DL)-based primary tumor biopsy signature for predicting axillary lymph node (ALN) metastasis preoperatively in early breast cancer (EBC) patients with clinically negative ALN. Methods A total of 1,058 EBC patients with pathologically confirmed ALN status were enrolled from May 2010 to August 2020. A DL core-needle biopsy (DL-CNB) model was built on the attention-based multiple instance-learning (AMIL) framework to predict ALN status utilizing the DL features, which were extracted from the cancer areas of digitized whole-slide images (WSIs) of breast CNB specimens annotated by two pathologists. Accuracy, sensitivity, specificity, receiver operating characteristic (ROC) curves, and areas under the ROC curve (AUCs) were analyzed to evaluate our model. Results The best-performing DL-CNB model with VGG16_BN as the feature extractor achieved an AUC of 0.816 (95% confidence interval (CI): 0.758, 0.865) in predicting positive ALN metastasis in the independent test cohort. Furthermore, our model incorporating the clinical data, which was called DL-CNB+C, yielded the best accuracy of 0.831 (95%CI: 0.775, 0.878), especially for patients younger than 50 years (AUC: 0.918, 95%CI: 0.825, 0.971). The interpretation of DL-CNB model showed that the top signatures most predictive of ALN metastasis were characterized by the nucleus features including density (p = 0.015), circumference (p = 0.009), circularity (p = 0.010), and orientation (p = 0.012). Conclusion Our study provides a novel DL-based biomarker on primary tumor CNB slides to predict the metastatic status of ALN preoperatively for patients with EBC.

[1]  Alaattin Erkanli,et al.  Rapid staining and imaging of subnuclear features to differentiate between malignant and benign breast tissues at a point-of-care setting , 2016, Journal of Cancer Research and Clinical Oncology.

[2]  Frank Hutter,et al.  SGDR: Stochastic Gradient Descent with Warm Restarts , 2016, ICLR.

[3]  M. Marzola,et al.  Sentinel Lymph Node Biopsy in Breast Cancer: Indications, Contraindications, and Controversies , 2016, Clinical nuclear medicine.

[4]  David F. Steiner,et al.  Impact of Deep Learning Assistance on the Histopathologic Review of Lymph Nodes for Metastatic Breast Cancer , 2018, The American journal of surgical pathology.

[5]  E. DeLong,et al.  Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. , 1988, Biometrics.

[6]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  George Lee,et al.  Nuclear Shape and Architecture in Benign Fields Predict Biochemical Recurrence in Prostate Cancer Patients Following Radical Prostatectomy: Preliminary Findings. , 2016, European urology focus.

[8]  A. Madabhushi,et al.  Quantitative nuclear histomorphometry predicts oncotype DX risk categories for early stage ER+ breast cancer , 2018, BMC Cancer.

[9]  T. Ochiya,et al.  Serum miRNA–based Prediction of Axillary Lymph Node Metastasis in Breast Cancer , 2018, Clinical Cancer Research.

[10]  Qianjin Feng,et al.  Bag of deep features for preoperative prediction of sentinel lymph node metastasis in breast cancer , 2018, Physics in medicine and biology.

[11]  Mats Andersson,et al.  Multi-Resolution Networks for Semantic Segmentation in Whole Slide Images , 2018, COMPAY/OMIA@MICCAI.

[12]  N. Dubrawsky Cancer statistics , 1989, CA: a cancer journal for clinicians.

[13]  Stephen C. Benz,et al.  A deep learning image-based intrinsic molecular subtype classifier of breast tumors reveals tumor heterogeneity that may affect survival , 2020, Breast Cancer Research.

[14]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[15]  J. S. Marron,et al.  Multiple Instance Learning for Heterogeneous Images: Training a CNN for Histopathology , 2018, MICCAI.

[16]  Andreas Geiger,et al.  Computer Vision and Pattern Recognition 2020 , 2021, International Journal of Computer Vision.

[17]  Abhijit Guha Roy,et al.  Multiple instance learning of deep convolutional neural networks for breast histopathology whole slide classification , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[18]  Jia Deng,et al.  A large-scale hierarchical image database , 2009, CVPR 2009.

[19]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[20]  Kheir M. Al-Kodmany Preliminary Findings , 2020, The Urban Book Series.

[21]  J. Sengupta The Nonparametric Approach , 1989 .

[22]  Ying Wang,et al.  Multi-level colonoscopy malignant tissue detection with adversarial CAC-UNet , 2020, Neurocomputing.

[23]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Tapani Raiko,et al.  International Conference on Learning Representations (ICLR) , 2016 .

[25]  Yong Huang,et al.  Clinically applicable histopathological diagnosis system for gastric cancer detection using deep learning , 2020, Nature communications.

[26]  A. Madabhushi,et al.  Nuclear shape and orientation features from H&E images predict survival in early-stage estrogen receptor-positive breast cancers , 2018, Laboratory Investigation.

[27]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Thomas J. Fuchs,et al.  Clinical-grade computational pathology using weakly supervised deep learning on whole slide images , 2019, Nature Medicine.

[29]  E. Mohammadi,et al.  Barriers and facilitators related to the implementation of a physiological track and trigger system: A systematic review of the qualitative evidence , 2017, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[30]  A. Purushotham,et al.  Novel techniques for sentinel lymph node biopsy in breast cancer: a systematic review. , 2014, The Lancet. Oncology.

[31]  Ronan Collobert,et al.  From image-level to pixel-level labeling with Convolutional Networks , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  B. Anderson,et al.  Needle biopsy for breast cancer diagnosis: a quality metric for breast surgical practice. , 2014, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[33]  Fan Yang,et al.  Predicting Lymph Node Metastasis Using Histopathological Images Based on Multiple Instance Learning With Deep Graph Convolution , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  X. Cui,et al.  Lymph Node Metastasis Prediction from Primary Breast Cancer US Images Using Deep Learning. , 2019, Radiology.

[35]  Max Welling,et al.  Attention-based Deep Multiple Instance Learning , 2018, ICML.

[36]  Harald J. Hoekstra,et al.  Quality of Life After Sentinel Lymph Node Biopsy or Axillary Lymph Node Dissection in Stage I/II Breast Cancer Patients: A Prospective Longitudinal Study , 2008, Annals of Surgical Oncology.

[37]  J. Ji,et al.  Deep learning system for lymph node quantification and metastatic cancer identification from whole-slide pathology images , 2021, Gastric Cancer.

[38]  Xiaohui Xie,et al.  Deep Multi-instance Networks with Sparse Label Assignment for Whole Mammogram Classification , 2016, bioRxiv.

[39]  Kari C. Nadeau,et al.  in a prospective longitudinal study , 2020 .

[40]  L. Saal,et al.  Prediction of Lymph Node Metastasis in Breast Cancer by Gene Expression and Clinicopathological Models: Development and Validation within a Population-Based Cohort , 2019, Clinical Cancer Research.

[41]  Ji Feng,et al.  Deep MIML Network , 2017, AAAI.

[42]  Lei Jiang,et al.  A Deep Learning-Based Approach for Glomeruli Instance Segmentation from Multistained Renal Biopsy Pathologic Images. , 2021, The American journal of pathology.

[43]  P. Choyke,et al.  Multiresolution Application of Artificial Intelligence in Digital Pathology for Prediction of Positive Lymph Nodes From Primary Tumors in Bladder Cancer. , 2020, JCO clinical cancer informatics.

[44]  Caroline Uhler,et al.  Machine Learning for Nuclear Mechano-Morphometric Biomarkers in Cancer Diagnosis , 2017, Scientific Reports.

[45]  A. Jemal,et al.  Cancer statistics, 2019 , 2019, CA: a cancer journal for clinicians.

[46]  Danail Stoyanov,et al.  Computational Pathology and Ophthalmic Medical Image Analysis , 2018, Lecture Notes in Computer Science.

[47]  Sheryl G. A. Gabram,et al.  Surgical Complications Associated With Sentinel Lymph Node Biopsy: Results From a Prospective International Cooperative Group Trial , 2006, Annals of Surgical Oncology.

[48]  K. Arihiro,et al.  Deep Learning Models for Histopathological Classification of Gastric and Colonic Epithelial Tumours , 2020, Scientific Reports.

[49]  Luiz Eduardo Soares de Oliveira,et al.  Multiple instance learning for histopathological breast cancer image classification , 2019, Expert Syst. Appl..

[50]  D. Groheux,et al.  The Sentinel Node Procedure in Breast Cancer: Nuclear Medicine as the Starting Point , 2011, The Journal of Nuclear Medicine.

[51]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[52]  Yuanyuan Wang,et al.  Deep learning radiomics can predict axillary lymph node status in early-stage breast cancer , 2020, Nature Communications.

[53]  Honghao Gao,et al.  A Deep Learning Approach for Colonoscopy Pathology WSI Analysis: Accurate Segmentation and Classification , 2020, IEEE Journal of Biomedical and Health Informatics.

[54]  M. Rantalainen,et al.  Artificial intelligence as the next step towards precision pathology , 2020, Journal of internal medicine.

[55]  Lei Wu,et al.  Deep Learning Signature Based on Staging CT for Preoperative Prediction of Sentinel Lymph Node Metastasis in Breast Cancer. , 2019, Academic radiology.

[56]  Jun Liu,et al.  Cross-Stained Segmentation from Renal Biopsy Images Using Multi-Level Adversarial Learning , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).