A Technical Review of Convolutional Neural Network-Based Mammographic Breast Cancer Diagnosis

This study reviews the technique of convolutional neural network (CNN) applied in a specific field of mammographic breast cancer diagnosis (MBCD). It aims to provide several clues on how to use CNN for related tasks. MBCD is a long-standing problem, and massive computer-aided diagnosis models have been proposed. The models of CNN-based MBCD can be broadly categorized into three groups. One is to design shallow or to modify existing models to decrease the time cost as well as the number of instances for training; another is to make the best use of a pretrained CNN by transfer learning and fine-tuning; the third is to take advantage of CNN models for feature extraction, and the differentiation of malignant lesions from benign ones is fulfilled by using machine learning classifiers. This study enrolls peer-reviewed journal publications and presents technical details and pros and cons of each model. Furthermore, the findings, challenges and limitations are summarized and some clues on the future work are also given. Conclusively, CNN-based MBCD is at its early stage, and there is still a long way ahead in achieving the ultimate goal of using deep learning tools to facilitate clinical practice. This review benefits scientific researchers, industrial engineers, and those who are devoted to intelligent cancer diagnosis.

[1]  Xinbo Gao,et al.  A deep feature based framework for breast masses classification , 2016, Neurocomputing.

[2]  L. Tabár,et al.  REDUCTION IN MORTALITY FROM BREAST CANCER AFTER MASS SCREENING WITH MAMMOGRAPHY Randomised Trial from the Breast Cancer Screening Working Group of the Swedish National Board of Health and Welfare , 1985, The Lancet.

[3]  Gustavo Carneiro,et al.  Fully automated classification of mammograms using deep residual neural networks , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[4]  Miguel Ángel Guevara-López,et al.  An evaluation of image descriptors combined with clinical data for breast cancer diagnosis , 2013, International Journal of Computer Assisted Radiology and Surgery.

[5]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[6]  Xuelong Li,et al.  A case-oriented web-based training system for breast cancer diagnosis , 2018, Comput. Methods Programs Biomed..

[7]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  A. Ramli,et al.  Computer-aided detection/diagnosis of breast cancer in mammography and ultrasound: a review. , 2013, Clinical imaging.

[9]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Miguel Ángel Guevara-López,et al.  Representation learning for mammography mass lesion classification with convolutional neural networks , 2016, Comput. Methods Programs Biomed..

[11]  R. Nishikawa,et al.  Automated mammographic breast density estimation using a fully convolutional network , 2018, Medical physics.

[12]  Alex Lallement,et al.  Survey on deep learning for radiotherapy , 2018, Comput. Biol. Medicine.

[13]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Yaoqin Xie,et al.  Nonrigid Registration of Lung CT Images Based on Tissue Features , 2013, Comput. Math. Methods Medicine.

[15]  Yaoqin Xie,et al.  Transferring deep neural networks for the differentiation of mammographic breast lesions , 2018, Science China Technological Sciences.

[16]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[17]  Sotiris B. Kotsiantis,et al.  Machine learning: a review of classification and combining techniques , 2006, Artificial Intelligence Review.

[18]  V Fanti,et al.  Towards breast tomography with synchrotron radiation at Elettra: first images , 2016, Physics in medicine and biology.

[19]  Wenqing Sun,et al.  Enhancing deep convolutional neural network scheme for breast cancer diagnosis with unlabeled data , 2017, Comput. Medical Imaging Graph..

[20]  Tao Lu,et al.  Image Deformation With Vector-Field Interpolation Based on MRLS-TPS , 2018, IEEE Access.

[21]  Yaoqin Xie,et al.  Evaluation of realistic blurring image quality by using a shallow convolutional neural network , 2017, 2017 IEEE International Conference on Information and Automation (ICIA).

[22]  Kai Zhang,et al.  Deep learning for image-based cancer detection and diagnosis - A survey , 2018, Pattern Recognit..

[23]  Natalia Antropova,et al.  A deep feature fusion methodology for breast cancer diagnosis demonstrated on three imaging modality datasets , 2017, Medical physics.

[24]  Lubomir M. Hadjiiski,et al.  Multi-task transfer learning deep convolutional neural network: application to computer-aided diagnosis of breast cancer on mammograms , 2017, Physics in medicine and biology.

[25]  Steve B. Jiang,et al.  A deep convolutional neural network-based automatic delineation strategy for multiple brain metastases stereotactic radiosurgery , 2017, PloS one.

[26]  Robert M. Nishikawa,et al.  A study on several Machine-learning methods for classification of Malignant and benign clustered microcalcifications , 2005, IEEE Transactions on Medical Imaging.

[27]  Wanqing Chen,et al.  Breast cancer in China. , 2014, The Lancet. Oncology.

[28]  M. A. Al-masni,et al.  Detection and classification of the breast abnormalities in digital mammograms via regional Convolutional Neural Network , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[29]  Shing-Tung Yau,et al.  Geometric Understanding of Deep Learning , 2018, ArXiv.

[30]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[31]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.

[32]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Yaoqin Xie,et al.  Can Signal-to-Noise Ratio Perform as a Baseline Indicator for Medical Image Quality Assessment , 2018, IEEE Access.

[34]  Lubomir M. Hadjiiski,et al.  Evolutionary pruning of transfer learned deep convolutional neural network for breast cancer diagnosis in digital breast tomosynthesis , 2018, Physics in medicine and biology.

[35]  M. Benndorf,et al.  Provision of the DDSM mammography metadata in an accessible format. , 2014, Medical physics.

[36]  Elizabeth A. Krupinski,et al.  Artificial intelligence will soon change the landscape of medical physics research and practice. , 2018, Medical physics.

[37]  Nisreen I. R. Yassin,et al.  Machine learning techniques for breast cancer computer aided diagnosis using different image modalities: A systematic review , 2018, Comput. Methods Programs Biomed..

[38]  Andrew Zisserman,et al.  Return of the Devil in the Details: Delving Deep into Convolutional Nets , 2014, BMVC.

[39]  Hiba Chougrad,et al.  Deep Convolutional Neural Networks for breast cancer screening , 2018, Comput. Methods Programs Biomed..

[40]  Xiaoqin Wang,et al.  Classification of Whole Mammogram and Tomosynthesis Images Using Deep Convolutional Neural Networks , 2018, IEEE Transactions on NanoBioscience.

[41]  Ian W. Ricketts,et al.  The Mammographic Image Analysis Society digital mammogram database , 1994 .

[42]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[43]  Yaoqin Xie,et al.  Iterative image-domain ring artifact removal in cone-beam CT , 2017, Physics in medicine and biology.

[44]  Fei Wang,et al.  Deep learning for healthcare: review, opportunities and challenges , 2018, Briefings Bioinform..

[45]  Edwin Valarezo,et al.  Simultaneous Detection and Classification of Breast Masses in Digital Mammograms via a Deep Learning YOLO-based CAD System , 2018, Comput. Methods Programs Biomed..

[46]  A. Jones,et al.  Reduction in mortality from breast cancer , 2005, BMJ : British Medical Journal.

[47]  Gustavo Carneiro,et al.  A deep learning approach for the analysis of masses in mammograms with minimal user intervention , 2017, Medical Image Anal..

[48]  C P Lawinski,et al.  A comparison of the accuracy of film-screen mammography, full-field digital mammography, and digital breast tomosynthesis. , 2012, Clinical radiology.

[49]  Christoph Meinel,et al.  Deep Learning for Medical Image Analysis , 2018, Journal of Pathology Informatics.

[50]  Arnaldo de Albuquerque Araújo,et al.  Toward a standard reference database for computer-aided mammography , 2008, SPIE Medical Imaging.

[51]  Luís A. Alexandre,et al.  Lesion classification in mammograms using convolutional neural networks and transfer learning , 2019 .

[52]  A. Jemal,et al.  Cancer statistics, 2016 , 2016, CA: a cancer journal for clinicians.

[53]  Qi Tian,et al.  Good Practice in CNN Feature Transfer , 2016, ArXiv.

[54]  Minho Lee,et al.  Improvement of fully automated airway segmentation on volumetric computed tomographic images using a 2.5 dimensional convolutional neural net☆ , 2019, Medical Image Anal..

[55]  Jaime S. Cardoso,et al.  INbreast: toward a full-field digital mammographic database. , 2012, Academic radiology.

[56]  Ali Selamat,et al.  Breast Cancer Detection Using Infrared Thermal Imaging and a Deep Learning Model , 2018, Sensors.

[57]  Wenjian Qin,et al.  Comparison of Transferred Deep Neural Networks in Ultrasonic Breast Masses Discrimination , 2018, BioMed research international.

[58]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[59]  M. Giger,et al.  Improving breast cancer diagnosis with computer-aided diagnosis. , 1999, Academic radiology.

[60]  Hui Li,et al.  Digital mammographic tumor classification using transfer learning from deep convolutional neural networks , 2016, Journal of medical imaging.

[61]  Paul Kinahan,et al.  Radiomics: Images Are More than Pictures, They Are Data , 2015, Radiology.

[62]  Qianni Zhang,et al.  Three-Class Mammogram Classification Based on Descriptive CNN Features , 2017, BioMed research international.

[63]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[64]  Rebecca L. Siegel Mph,et al.  Cancer statistics, 2016 , 2016 .

[65]  Zhengrong Liang,et al.  Quantitative Identification of Nonmuscle‐Invasive and Muscle‐Invasive Bladder Carcinomas: A Multiparametric MRI Radiomics Analysis , 2018, Journal of magnetic resonance imaging : JMRI.

[66]  Hideo Yokota,et al.  Comparison of Machine-Learning Classification Models for Glaucoma Management , 2018, Journal of healthcare engineering.

[67]  Gustavo Carneiro,et al.  Unregistered Multiview Mammogram Analysis with Pre-trained Deep Learning Models , 2015, MICCAI.

[68]  Michael S. Lew,et al.  Deep learning for visual understanding: A review , 2016, Neurocomputing.

[69]  Ronald M. Summers,et al.  Deep Learning in Medical Imaging: Overview and Future Promise of an Exciting New Technique , 2016 .

[70]  Li Liu,et al.  Breast mass classification via deeply integrating the contextual information from multi-view data , 2018, Pattern Recognit..

[71]  Yaoqin Xie,et al.  A Feasibility of Respiration Prediction Based on Deep Bi-LSTM for Real-Time Tumor Tracking , 2018, IEEE Access.

[72]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[73]  Yaoqin Xie,et al.  A Sparse-View CT Reconstruction Method Based on Combination of DenseNet and Deconvolution , 2018, IEEE Transactions on Medical Imaging.

[74]  Arnau Oliver,et al.  A review of automatic mass detection and segmentation in mammographic images , 2010, Medical Image Anal..

[75]  Jia Gu,et al.  Superpixel-based and boundary-sensitive convolutional neural network for automated liver segmentation , 2018, Physics in medicine and biology.

[76]  Changyong Liang,et al.  A case-based reasoning system based on weighted heterogeneous value distance metric for breast cancer diagnosis , 2017, Artif. Intell. Medicine.

[77]  István Csabai,et al.  Detecting and classifying lesions in mammograms with Deep Learning , 2017, Scientific Reports.

[78]  Linghong Zhou,et al.  Deep convolutional neural network with transfer learning for rectum toxicity prediction in cervical cancer radiotherapy: a feasibility study , 2017, Physics in medicine and biology.

[79]  Bo Gao,et al.  Improved Cost-Sensitive Support Vector Machine Classifier for Breast Cancer Diagnosis , 2018, Mathematical Problems in Engineering.

[80]  Hui Li,et al.  Transfer Learning From Convolutional Neural Networks for Computer-Aided Diagnosis: A Comparison of Digital Breast Tomosynthesis and Full-Field Digital Mammography. , 2019, Academic radiology.

[81]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[82]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[83]  Richard H. Moore,et al.  Current Status of the Digital Database for Screening Mammography , 1998, Digital Mammography / IWDM.

[84]  Ulas Bagci,et al.  Deep learning beyond cats and dogs: recent advances in diagnosing breast cancer with deep neural networks. , 2018, The British journal of radiology.

[85]  G. Kokkinakis,et al.  Computer aided diagnosis of breast cancer in digitized mammograms. , 2002, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[86]  Rangaraj M. Rangayyan,et al.  A review of computer-aided diagnosis of breast cancer: Toward the detection of subtle signs , 2007, J. Frankl. Inst..

[87]  Yongyi Yang,et al.  Computer-Aided Detection and Diagnosis of Breast Cancer With Mammography: Recent Advances , 2009, IEEE Transactions on Information Technology in Biomedicine.

[88]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[89]  Computer-Aided Diagnosis of Mammographic Masses using Scalable Image Retrieval , 2017 .

[90]  Wojciech Samek,et al.  Methods for interpreting and understanding deep neural networks , 2017, Digit. Signal Process..

[91]  Heng-Da Cheng,et al.  Computer-aided detection and classification of microcalcifications in mammograms: a survey , 2003, Pattern Recognit..

[92]  K. Holland,et al.  Optimization of volumetric breast density estimation in digital mammograms. , 2017, Physics in medicine and biology.

[93]  H. Aerts,et al.  Applications and limitations of radiomics , 2016, Physics in medicine and biology.

[94]  Bradley J. Erickson,et al.  Deep Learning in Radiology: Does One Size Fit All? , 2018, Journal of the American College of Radiology : JACR.

[95]  Ling Zhang,et al.  Automated breast cancer detection and classification using ultrasound images: A survey , 2015, Pattern Recognit..

[96]  Reyer Zwiggelaar,et al.  Deep learning in mammography and breast histology, an overview and future trends , 2018, Medical Image Anal..

[97]  Yaoqin Xie,et al.  Efficient Segmentation of a Breast in B-Mode Ultrasound Tomography Using Three-Dimensional GrabCut (GC3D) , 2017, Sensors.

[98]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[99]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[100]  F. Hall,et al.  Nonpalpable breast lesions: recommendations for biopsy based on suspicion of carcinoma at mammography. , 1988, Radiology.

[101]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[102]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[103]  Lei Wang,et al.  A shallow convolutional neural network for blind image sharpness assessment , 2017, PloS one.

[104]  Xinbo Gao,et al.  A parasitic metric learning net for breast mass classification based on mammography , 2018, Pattern Recognit..

[105]  Shiju Yan,et al.  A new approach to develop computer-aided diagnosis scheme of breast mass classification using deep learning technology. , 2017, Journal of X-ray science and technology.

[106]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[107]  Hao Chen,et al.  3D deeply supervised network for automated segmentation of volumetric medical images , 2017, Medical Image Anal..