Reducing False-Positive Biopsies using Deep Neural Networks that Utilize both Local and Global Image Context of Screening Mammograms

Breast cancer is the most common cancer in women, and hundreds of thousands of unnecessary biopsies are done around the world at a tremendous cost. It is crucial to reduce the rate of biopsies that turn out to be benign tissue. In this study, we build deep neural networks (DNNs) to classify biopsied lesions as being either malignant or benign, with the goal of using these networks as second readers serving radiologists to further reduce the number of false-positive findings. We enhance the performance of DNNs that are trained to learn from small image patches by integrating global context provided in the form of saliency maps learned from the entire image into their reasoning, similar to how radiologists consider global context when evaluating areas of interest. Our experiments are conducted on a dataset of 229,426 screening mammography examinations from 141,473 patients. We achieve an AUC of 0.8 on a test set consisting of 464 benign and 136 malignant lesions.

[1]  Brian Griffin,et al.  Analysis of utilization patterns and associated costs of the breast imaging and diagnostic procedures after screening mammography , 2018, ClinicoEconomics and outcomes research : CEOR.

[2]  Kyunghyun Cho,et al.  Globally-Aware Multiple Instance Classifier for Breast Cancer Screening , 2019, MLMI@MICCAI.

[3]  Mark A Helvie,et al.  Breast Cancer Screening for Average-Risk Women: Recommendations From the ACR Commission on Breast Imaging. , 2017, Journal of the American College of Radiology : JACR.

[4]  Eun-Kyung Kim,et al.  Applying Data-driven Imaging Biomarker in Mammography for Breast Cancer Screening: Preliminary Study , 2018, Scientific Reports.

[5]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[7]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[8]  Xavier Lladó,et al.  Automatic mass detection in mammograms using deep convolutional neural networks , 2019, Journal of medical imaging.

[9]  Xiaohui Xie,et al.  Deep Multi-instance Networks with Sparse Label Assignment for Whole Mammogram Classification , 2016, bioRxiv.

[10]  Joann G Elmore,et al.  Cost of Breast-Related Care in the Year Following False Positive Screening Mammograms , 2010, Medical care.

[11]  Douglas K Owens,et al.  Medication Use to Reduce Risk of Breast Cancer: US Preventive Services Task Force Recommendation Statement. , 2019, JAMA.

[12]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[13]  Linda Moy,et al.  Screening Guidelines Update for Average-Risk and High-Risk Women. , 2019, AJR. American journal of roentgenology.

[14]  Berkman Sahiner,et al.  Association of computerized mammographic parenchymal pattern measure with breast cancer risk: a pilot case-control study. , 2011, Radiology.

[15]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[16]  M. Elter,et al.  The prediction of breast cancer biopsy outcomes using two CAD approaches that both emphasize an intelligible decision process. , 2007, Medical physics.

[17]  C. Lehman,et al.  Diagnostic Accuracy of Digital Screening Mammography With and Without Computer-Aided Detection. , 2015, JAMA internal medicine.

[18]  Nan Wu,et al.  Deep Neural Networks Improve Radiologists’ Performance in Breast Cancer Screening , 2019, IEEE Transactions on Medical Imaging.

[19]  Natasha K. Stout,et al.  Association of Digital Breast Tomosynthesis vs Digital Mammography With Cancer Detection and Recall Rates by Age and Breast Density , 2019, JAMA oncology.

[20]  Jessica W T Leung,et al.  Multiple Bilateral Circumscribed Breast Masses Detected at Imaging: Review of Evidence for Management Recommendations. , 2019, AJR. American journal of roentgenology.

[21]  Isabel dos Santos Silva,et al.  The spatial distribution of radiodense breast tissue: a longitudinal study , 2009, Breast Cancer Research.

[22]  Mihaela van der Schaar,et al.  MAMMO: A Deep Learning Solution for Facilitating Radiologist-Machine Collaboration in Breast Cancer Diagnosis , 2018, ArXiv.

[23]  C. Lehman,et al.  National Performance Benchmarks for Modern Screening Digital Mammography: Update from the Breast Cancer Surveillance Consortium. , 2017, Radiology.

[24]  David S. Melnick,et al.  International evaluation of an AI system for breast cancer screening , 2020, Nature.

[25]  Aly A. Mohamed,et al.  Deep Learning to Distinguish Recalled but Benign Mammography Images in Breast Cancer Screening , 2018, Clinical Cancer Research.

[26]  J. Lortet-Tieulent,et al.  Breast Cancer Screening for Women at Average Risk: 2015 Guideline Update From the American Cancer Society. , 2015, JAMA.

[27]  Rafik Goubran,et al.  Abnormality Detection in Mammography using Deep Convolutional Neural Networks , 2018, 2018 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[28]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[29]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  István Csabai,et al.  Detecting and classifying lesions in mammograms with Deep Learning , 2017, Scientific Reports.

[31]  Yaping Huang,et al.  Multi-label chest X-ray image classification via category-wise residual attention learning , 2020, Pattern Recognit. Lett..

[32]  Masoumeh Haghpanahi,et al.  Cardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural network , 2019, Nature Medicine.

[33]  E A Sickles,et al.  Multiple bilateral masses detected on screening mammography: assessment of need for recall imaging. , 2000, AJR. American journal of roentgenology.

[34]  C. D'Orsi,et al.  Influence of computer-aided detection on performance of screening mammography. , 2007, The New England journal of medicine.

[35]  Ronald M. Summers,et al.  ChestX-ray: Hospital-Scale Chest X-ray Database and Benchmarks on Weakly Supervised Classification and Localization of Common Thorax Diseases , 2019, Deep Learning and Convolutional Neural Networks for Medical Imaging and Clinical Informatics.

[36]  Yizhou Yu,et al.  Cross-View Correspondence Reasoning Based on Bipartite Graph Convolutional Network for Mammogram Mass Detection , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Lubomir M. Hadjiiski,et al.  Mass detection in digital breast tomosynthesis: Deep convolutional neural network with transfer learning from mammography. , 2016, Medical physics.

[38]  K. Mandl,et al.  National expenditure for false-positive mammograms and breast cancer overdiagnoses estimated at $4 billion a year. , 2015, Health affairs.

[39]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[40]  Nan Wu,et al.  An interpretable classifier for high-resolution breast cancer screening images utilizing weakly supervised localization , 2020, Medical Image Anal..

[41]  Luiz Eduardo Soares de Oliveira,et al.  Breast cancer histopathological image classification using Convolutional Neural Networks , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).