Deep learning beyond cats and dogs: recent advances in diagnosing breast cancer with deep neural networks.

Deep learning has demonstrated tremendous revolutionary changes in the computing industry and its effects in radiology and imaging sciences have begun to dramatically change screening paradigms. Specifically, these advances have influenced the development of computer-aided detection and diagnosis (CAD) systems. These technologies have long been thought of as "second-opinion" tools for radiologists and clinicians. However, with significant improvements in deep neural networks, the diagnostic capabilities of learning algorithms are approaching levels of human expertise (radiologists, clinicians etc.), shifting the CAD paradigm from a "second opinion" tool to a more collaborative utility. This paper reviews recently developed CAD systems based on deep learning technologies for breast cancer diagnosis, explains their superiorities with respect to previously established systems, defines the methodologies behind the improved achievements including algorithmic developments, and describes remaining challenges in breast cancer screening and diagnosis. We also discuss possible future directions for new CAD models that continue to change as artificial intelligence algorithms evolve.

[1]  Xinbo Gao,et al.  A deep feature based framework for breast masses classification , 2016, Neurocomputing.

[2]  Dimitrios I. Fotiadis,et al.  Machine learning applications in cancer prognosis and prediction , 2014, Computational and structural biotechnology journal.

[3]  C. D'Orsi,et al.  Influence of computer-aided detection on performance of screening mammography. , 2007, The New England journal of medicine.

[4]  Ayman El-Baz,et al.  Computer-Aided Diagnosis Systems for Lung Cancer: Challenges and Methodologies , 2013, Int. J. Biomed. Imaging.

[5]  Nico Karssemeijer,et al.  Large scale deep learning for computer aided detection of mammographic lesions , 2017, Medical Image Anal..

[6]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[7]  Gustavo Carneiro,et al.  Unregistered Multiview Mammogram Analysis with Pre-trained Deep Learning Models , 2015, MICCAI.

[8]  A. Joy Christy,et al.  Prediction of Breast Cancer through Classification Algorithms: A Survey , 2022 .

[9]  S. Shanthi,et al.  Application of Data Mining Techniques to Model Breast Cancer Data , 2013 .

[10]  David S. Wishart,et al.  Applications of Machine Learning in Cancer Prediction and Prognosis , 2006, Cancer informatics.

[11]  Byunghan Lee,et al.  Deep learning in bioinformatics , 2016, Briefings Bioinform..

[12]  M. Schwaiger,et al.  Breast imaging with positron emission tomography and fluorine-18 fluorodeoxyglucose: use and limitations. , 2000, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[13]  Wolfgang Bogner,et al.  Improved Differentiation of Benign and Malignant Breast Tumors with Multiparametric 18Fluorodeoxyglucose Positron Emission Tomography Magnetic Resonance Imaging: A Feasibility Study , 2014, Clinical Cancer Research.

[14]  Yunsong Li,et al.  Breast mass classification in digital mammography based on extreme learning machine , 2016, Neurocomputing.

[15]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[16]  Jason Weston,et al.  End-To-End Memory Networks , 2015, NIPS.

[17]  Gustavo Carneiro,et al.  Deep Learning and Structured Prediction for the Segmentation of Mass in Mammograms , 2015, MICCAI.

[18]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[19]  Yi Wang,et al.  A New Machine Learning Algorithm for Breast and Pectoral Muscle Segmentation , 2015 .

[20]  Lubomir M. Hadjiiski,et al.  Mass detection in digital breast tomosynthesis: Deep convolutional neural network with transfer learning from mammography. , 2016, Medical physics.

[21]  Kawal S. Rhode,et al.  CardiacNET: Segmentation of Left Atrium and Proximal Pulmonary Veins from MRI Using Multi-view CNN , 2017, MICCAI.

[22]  Qianni Zhang,et al.  Three-Class Mammogram Classification Based on Descriptive CNN Features , 2017, BioMed research international.

[23]  Thomas Frauenfelder,et al.  Deep Learning in Mammography: Diagnostic Accuracy of a Multipurpose Image Analysis Software in the Detection of Breast Cancer , 2017, Investigative radiology.

[24]  Qi Zhang,et al.  Deep learning based classification of breast tumors with shear-wave elastography. , 2016, Ultrasonics.

[25]  Rob Fergus,et al.  Stochastic Pooling for Regularization of Deep Convolutional Neural Networks , 2013, ICLR.

[26]  Yann LeCun,et al.  Regularization of Neural Networks using DropConnect , 2013, ICML.

[27]  Gustavo Carneiro,et al.  The Automated Learning of Deep Features for Breast Mass Classification from Mammograms , 2016, MICCAI.

[28]  N. Albert Singh,et al.  Breast Cancer Diagnosis: An Intelligent Detection System Using Wavelet Neural Network , 2013, FICTA.

[29]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[30]  Nico Karssemeijer,et al.  Breast Tissue Segmentation and Mammographic Risk Scoring Using Deep Learning , 2014, Digital Mammography / IWDM.

[31]  Hui Li,et al.  Digital mammographic tumor classification using transfer learning from deep convolutional neural networks , 2016, Journal of medical imaging.

[32]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[33]  Hans-Peter Seidel,et al.  Deep Shading: Convolutional Neural Networks for Screen Space Shading , 2016, Comput. Graph. Forum.

[34]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[35]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[36]  Ulas Bagci,et al.  How to fool radiologists with generative adversarial networks? A visual turing test for lung cancer diagnosis , 2017, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[37]  Abeer Alsadoon,et al.  Early diagnosis of breast cancer using contrast limited adaptive histogram equalization (CLAHE) and Morphology methods , 2017, 2017 8th International Conference on Information and Communication Systems (ICICS).

[38]  Berkman Sahiner,et al.  Classification of mass and normal breast tissue: a convolution neural network classifier with spatial domain and texture images , 1996, IEEE Trans. Medical Imaging.

[39]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[40]  Xiaoming Xi,et al.  Breast tumor segmentation with prior knowledge learning , 2017, Neurocomputing.

[41]  Ram Sarkar,et al.  Breast cancer detection using feature selection and active learning , 2017 .

[42]  Max A. Viergever,et al.  Deep Learning for Multi-Task Medical Image Segmentation in Multiple Modalities , 2016, MICCAI.

[43]  Mark Goadrich,et al.  The relationship between Precision-Recall and ROC curves , 2006, ICML.

[44]  Xiangrong Zhou,et al.  Automated assessment of breast tissue density in non-contrast 3D CT images without image segmentation based on a deep CNN , 2017, Medical Imaging.

[45]  Miguel Ángel Guevara-López,et al.  Representation learning for mammography mass lesion classification with convolutional neural networks , 2016, Comput. Methods Programs Biomed..

[46]  Yi-Ping Phoebe Chen,et al.  Image based computer aided diagnosis system for cancer detection , 2015, Expert Syst. Appl..

[47]  Yin Yin,et al.  Detection of soft tissue densities from digital breast tomosynthesis: comparison of conventional and deep learning approaches , 2016, SPIE Medical Imaging.

[48]  D. Montoya-Zapata,et al.  Detection and Diagnosis of Breast Tumors using Deep Convolutional Neural Networks , 2016 .

[49]  David Gur,et al.  Localized detection and classification of abnormalities on FFDM and tomosynthesis examinations rated under an FROC paradigm. , 2011, AJR. American journal of roentgenology.

[50]  Gustavo Carneiro,et al.  Automated Mass Detection in Mammograms Using Cascaded Deep Learning and Random Forests , 2015, 2015 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[51]  Kemal Polat,et al.  Breast cancer diagnosis using least square support vector machine , 2007, Digit. Signal Process..

[52]  AbreuPedro Henriques,et al.  Predicting Breast Cancer Recurrence Using Machine Learning Techniques , 2016 .

[53]  Ulas Bagci,et al.  Risk Stratification of Lung Nodules Using 3D CNN-Based Multi-task Learning , 2017, IPMI.

[54]  Lubomir M. Hadjiiski,et al.  Deep-learning convolution neural network for computer-aided detection of microcalcifications in digital breast tomosynthesis , 2016, SPIE Medical Imaging.

[55]  Rama Ramaswami.  Artificial Intelligence: Is the Future Now for A.I.?. , 2009 .

[56]  Leonid Karlinsky,et al.  A Region Based Convolutional Network for Tumor Detection and Classification in Breast Mammography , 2016, LABELS/DLMIA@MICCAI.

[57]  Chih-Fong Tsai,et al.  SVM and SVM Ensembles in Breast Cancer Prediction , 2017, PloS one.

[58]  Samuel Cheng,et al.  An initial investigation on developing a new method to predict short-term breast cancer risk based on deep learning technology , 2016, SPIE Medical Imaging.

[59]  Arpitam Chatterjee,et al.  Image Contrast Enhancement Using a Crossover-Included Hybrid Artificial Bee Colony Optimization , 2017 .

[60]  N. Karssemeijer,et al.  Discriminating solitary cysts from soft tissue lesions in mammography using a pretrained deep convolutional neural network , 2017, Medical physics.

[61]  Bénédicte M A Delattre,et al.  PET/MR in Breast Cancer. , 2015, Seminars in nuclear medicine.

[62]  Daniel L. Rubin,et al.  Probabilistic visual search for masses within mammography images using deep learning , 2015, 2015 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[63]  Nicholas D. Lane,et al.  An Early Resource Characterization of Deep Learning on Wearables, Smartphones and Internet-of-Things Devices , 2015, IoT-App@SenSys.

[64]  Mehmet Fatih Akay,et al.  Support vector machines combined with feature selection for breast cancer diagnosis , 2009, Expert Syst. Appl..

[65]  Lihua Li,et al.  Discriminating between benign and malignant breast tumors using 3D convolutional neural network in dynamic contrast enhanced-MR images , 2017, Medical Imaging.

[66]  Xinjian Chen,et al.  Medical Image Segmentation by Combining Graph Cuts and Oriented Active Appearance Models , 2012, IEEE Transactions on Image Processing.

[67]  Abdul Qayyum,et al.  Automatic breast segmentation and cancer detection via SVM in mammograms , 2016, 2016 International Conference on Emerging Technologies (ICET).

[68]  André Luckow,et al.  Deep learning in the automotive industry: Applications and tools , 2016, 2016 IEEE International Conference on Big Data (Big Data).

[69]  Nico Karssemeijer,et al.  Using deep learning to segment breast and fibroglandular tissue in MRI volumes , 2017, Medical physics.

[70]  D. Shen,et al.  Computer-Aided Diagnosis with Deep Learning Architecture: Applications to Breast Lesions in US Images and Pulmonary Nodules in CT Scans , 2016, Scientific Reports.