A Novel Deep-Learning Model for Automatic Detection and Classification of Breast Cancer Using the Transfer-Learning Technique

Breast cancer (BC) is one of the primary causes of cancer death among women. Early detection of BC allows patients to receive appropriate treatment, thus increasing the possibility of survival. In this work, a new deep-learning (DL) model based on the transfer-learning (TL) technique is developed to efficiently assist in the automatic detection and diagnosis of the BC suspected area based on two techniques namely 80–20 and cross-validation. DL architectures are modeled to be problem-specific. TL uses the knowledge gained during solving one problem in another relevant problem. In the proposed model, the features are extracted from the mammographic image analysis- society (MIAS) dataset using a pre-trained convolutional neural network (CNN) architecture such as Inception V3, ResNet50, Visual Geometry Group networks (VGG)-19, VGG-16, and Inception-V2 ResNet. Six evaluation metrics for evaluating the performance of the proposed model in terms of accuracy, sensitivity, specificity, precision, F-score, and area under the ROC curve (AUC) has been chosen. Experimental results show that the TL of the VGG16 model is powerful for BC diagnosis by classifying the mammogram breast images with overall accuracy, sensitivity, specificity, precision, F-score, and AUC of 98.96%, 97.83%, 99.13%, 97.35%, 97.66%, and 0.995, respectively for 80–20 method and 98.87%, 97.27%, 98.2%, 98.84%, 98.04%, and 0.993 for 10-fold cross-validation method.

[1]  Naimatullah Shah,et al.  Predicting entrepreneurial intention among business students of public sector universities of Pakistan: an application of the entrepreneurial event model , 2020 .

[2]  Xiaolan Fu,et al.  MESNet: A Convolutional Neural Network for Spotting Multi-Scale Micro-Expression Intervals in Long Videos , 2021, IEEE Transactions on Image Processing.

[3]  Jun Li,et al.  An Intelligent Parkinson's Disease Diagnostic System Based on a Chaotic Bacterial Foraging Optimization Enhanced Fuzzy KNN Approach , 2018, Comput. Math. Methods Medicine.

[4]  Lihua You,et al.  Semantic portrait color transfer with internet images , 2015, Multimedia Tools and Applications.

[5]  Md. Zakirul Alam Bhuiyan,et al.  A Survey on Deep Learning in Big Data , 2017, 22017 IEEE International Conference on Computational Science and Engineering (CSE) and IEEE International Conference on Embedded and Ubiquitous Computing (EUC).

[6]  Shuhui Wang,et al.  Convolutional neural network-based hidden Markov models for rolling element bearing fault identification , 2017, Knowl. Based Syst..

[7]  Dacheng Tao,et al.  Top-k Feature Selection Framework Using Robust 0–1 Integer Programming , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Liang Du,et al.  Efficient sequential feature selection based on adaptive eigenspace model , 2015, Neurocomputing.

[9]  Xiaogang Jin,et al.  Parallel and efficient approximate nearest patch matching for image editing applications , 2018, Neurocomputing.

[10]  Haizhou Huang,et al.  A personalized diagnosis method to detect faults in gears using numerical simulation and extreme learning machine , 2020, Knowl. Based Syst..

[11]  Jun Li,et al.  Grey wolf optimization evolving kernel extreme learning machine: Application to bankruptcy prediction , 2017, Eng. Appl. Artif. Intell..

[12]  Babak Daneshvar Rouyendegh,et al.  Deep learning and optimization algorithms for automatic breast cancer detection , 2020, Int. J. Imaging Syst. Technol..

[13]  Zhengyuan Zhou,et al.  Robust Low-Rank Tensor Recovery with Rectification and Alignment , 2021, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Joel J. P. C. Rodrigues,et al.  A novel deep learning based framework for the detection and classification of breast cancer using transfer learning , 2019, Pattern Recognit. Lett..

[15]  Xiaoqin Zhang,et al.  Attention-based interpolation network for video deblurring , 2020, Neurocomputing.

[16]  Zafer Cömert,et al.  BreastNet: A novel convolutional neural network model through histopathological images for the diagnosis of breast cancer , 2020 .

[17]  Ying Chen,et al.  Towards augmented kernel extreme learning models for bankruptcy prediction: Algorithmic behavior and comprehensive analysis , 2020, Neurocomputing.

[18]  John See,et al.  Effective recognition of facial micro-expressions with video motion magnification , 2016, Multimedia Tools and Applications.

[19]  Lubomir M. Hadjiiski,et al.  Multi-task transfer learning deep convolutional neural network: application to computer-aided diagnosis of breast cancer on mammograms , 2017, Physics in medicine and biology.

[20]  Xianqin Wang,et al.  Metabolomics Analysis in Acute Paraquat Poisoning Patients Based on UPLC-Q-TOF-MS and Machine Learning Approach. , 2019, Chemical research in toxicology.

[21]  Asifullah Khan,et al.  Transfer learning based deep CNN for segmentation and detection of mitoses in breast cancer histopathological images. , 2019, Microscopy.

[22]  Ke Li,et al.  Epileptic seizure detection in EEG signals using sparse multiscale radial basis function networks and the Fisher vector approach , 2019, Knowl. Based Syst..

[23]  Huiling Chen,et al.  An Effective Machine Learning Approach for Prognosis of Paraquat Poisoning Patients Using Blood Routine Indexes , 2017, Basic & clinical pharmacology & toxicology.

[24]  Dayong Wang,et al.  Deep Learning for Identifying Metastatic Breast Cancer , 2016, ArXiv.

[25]  Huiling Chen,et al.  Using Blood Indexes to Predict Overweight Statuses: An Extreme Learning Machine-Based Approach , 2015, PloS one.

[26]  Xuehua Zhao,et al.  SGOA: annealing-behaved grasshopper optimizer for global tasks , 2021, Engineering with Computers.

[27]  Minnan Luo,et al.  Self-weighted Robust LDA for Multiclass Classification with Edge Classes , 2020, ACM Trans. Intell. Syst. Technol..

[28]  Hamza Turabieh,et al.  Double adaptive weights for stabilization of moth flame optimizer: Balance analysis, engineering cases, and medical diagnosis , 2021, Knowl. Based Syst..

[29]  Xiaolan Fu,et al.  CAS(ME)$^2$ : A Database for Spontaneous Macro-Expression and Micro-Expression Spotting and Recognition , 2018, IEEE Transactions on Affective Computing.

[30]  Yuping Li,et al.  Predict the Entrepreneurial Intention of Fresh Graduate Students Based on an Adaptive Support Vector Machine Framework , 2019, Mathematical Problems in Engineering.

[31]  Donghui Wang,et al.  A content-based recommender system for computer science publications , 2018, Knowl. Based Syst..

[32]  Tong Liu,et al.  Effective detection of Parkinson's disease using an adaptive fuzzy k-nearest neighbor approach , 2013, Biomed. Signal Process. Control..

[33]  Xiaoqin Zhang,et al.  Recursive Neural Network for Video Deblurring , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[34]  QiaoHong,et al.  Efficient isometric multi-manifold learning based on the self-organizing method , 2016 .

[35]  Hong Qiao,et al.  Dimensionality reduction: An interpretation from manifold regularization perspective , 2014, Inf. Sci..

[36]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[37]  Ying Huang,et al.  Chaos enhanced grey wolf optimization wrapped ELM for diagnosis of paraquat-poisoned patients , 2019, Comput. Biol. Chem..

[38]  P. Viale The American Cancer Society’s Facts & Figures: 2020 Edition , 2020, Journal of the advanced practitioner in oncology.

[39]  Robert Sabourin,et al.  Improve the performance of transfer learning without fine-tuning using dissimilarity-based multi-view learning for breast cancer histology images , 2018, ICIAR.

[40]  Xiaoqin Zhang,et al.  Pyramid Channel-based Feature Attention Network for image dehazing , 2020, Comput. Vis. Image Underst..

[41]  Xuehua Zhao,et al.  An improved grasshopper optimization algorithm with application to financial stress prediction , 2018, Applied Mathematical Modelling.

[42]  Hui Huang,et al.  Manifold-preserving image colorization with nonlocal estimation , 2015, Multimedia Tools and Applications.

[43]  U. Rajendra Acharya,et al.  Automated invasive ductal carcinoma detection based using deep transfer learning with whole-slide images , 2020, Pattern Recognit. Lett..

[44]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  Gang Wang,et al.  An efficient hybrid kernel extreme learning machine approach for early diagnosis of Parkinson's disease , 2016, Neurocomputing.

[46]  Li Zhao,et al.  Haze concentration adaptive network for image dehazing , 2021, Neurocomputing.

[47]  Shihui Ying,et al.  Projective parameter transfer based sparse multiple empirical kernel learning Machine for diagnosis of brain disease , 2020, Neurocomputing.

[48]  Xiaolan Fu,et al.  Face Recognition and Micro-expression Recognition Based on Discriminant Tensor Subspace Analysis Plus Extreme Learning Machine , 2014, Neural Processing Letters.

[49]  Huiling Chen,et al.  Predicting Intentions of Students for Master Programs Using a Chaos-Induced Sine Cosine-Based Fuzzy K-Nearest Neighbor Classifier , 2019, IEEE Access.

[50]  Hong Zhou,et al.  Ultrasound-based differentiation of malignant and benign thyroid Nodules: An extreme learning machine approach , 2017, Comput. Methods Programs Biomed..

[51]  Jiye G. Kim,et al.  Robust breast cancer detection in mammography and digital breast tomosynthesis using annotation-efficient deep learning approach , 2019, ArXiv.

[52]  Xiaogang Jin,et al.  Real-time directional stylization of images and videos , 2011, Multimedia Tools and Applications.

[53]  L. Yao,et al.  The Recognition of Multiple Anxiety Levels Based on Electroencephalograph , 2019, IEEE Transactions on Affective Computing.

[54]  Qian Zhang,et al.  An efficient chaotic mutative moth-flame-inspired optimizer for global optimization tasks , 2019, Expert Syst. Appl..

[55]  Pheng-Ann Heng,et al.  Weakly supervised 3D deep learning for breast cancer classification and localization of the lesions in MR images , 2019, Journal of magnetic resonance imaging : JMRI.

[56]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[57]  Huiling Chen,et al.  A New Evolutionary Machine Learning Approach for Identifying Pyrene Induced Hepatotoxicity and Renal Dysfunction in Rats , 2019, IEEE Access.

[58]  Yan Wei,et al.  An Improved Grey Wolf Optimization Strategy Enhanced SVM and Its Application in Predicting the Second Major , 2017 .

[59]  Guoying Zhao,et al.  A Main Directional Mean Optical Flow Feature for Spontaneous Micro-Expression Recognition , 2016, IEEE Transactions on Affective Computing.

[60]  Machine Learning for Breast Cancer Classification Using K-Star Algorithm , 2020, Applied Mathematics & Information Sciences.

[61]  Hui Huang,et al.  Learning a convolutional neural network for propagation-based stereo image segmentation , 2018, The Visual Computer.

[62]  Xuehua Zhao,et al.  An Efficient and Effective Automatic Recognition System for Online Recognition of Foreign Fibers in Cotton , 2016, IEEE Access.

[63]  Hui Huang,et al.  High-quality retinal vessel segmentation using generative adversarial network with a large receptive field , 2020, Int. J. Imaging Syst. Technol..

[64]  Hui Huang,et al.  Toward an optimal kernel extreme learning machine using a chaotic moth-flame optimization strategy with applications in medical diagnoses , 2017, Neurocomputing.

[65]  Zafer Aydin,et al.  A review of mammographic region of interest classification , 2020, WIREs Data Mining Knowl. Discov..

[66]  Tong Liu,et al.  A fast approach for detection of erythemato-squamous diseases based on extreme learning machine with maximum relevance minimum redundancy feature selection , 2015, Int. J. Syst. Sci..

[67]  S. A. George,et al.  BARRIERS TO BREAST CANCER SCREENING: AN INTEGRATIVE REVIEW , 2000, Health care for women international.

[68]  Jiawei Xiang,et al.  A simulation model based fault diagnosis method for bearings , 2018, J. Intell. Fuzzy Syst..

[69]  Xia Wu,et al.  Identifying Cortical Brain Directed Connectivity Networks From High-Density EEG for Emotion Recognition , 2020, IEEE Transactions on Affective Computing.

[70]  Xiaoqin Zhang,et al.  Pair-based Uncertainty and Diversity Promoting Early Active Learning for Person Re-identification , 2020, ACM Trans. Intell. Syst. Technol..

[71]  Jianhua Gu,et al.  Evolving an optimal kernel extreme learning machine by using an enhanced grey wolf optimization strategy , 2019, Expert Syst. Appl..

[72]  Khurram Khurshid,et al.  Breast cancer detection in mammograms using convolutional neural network , 2018, 2018 International Conference on Computing, Mathematics and Engineering Technologies (iCoMET).

[73]  Dayou Liu,et al.  Evolving support vector machines using fruit fly optimization for medical data classification , 2016, Knowl. Based Syst..

[74]  J. Dreher,et al.  Prediction of trust propensity from intrinsic brain morphology and functional connectome , 2020, Human brain mapping.

[75]  Gang Wang,et al.  An efficient diagnosis system for detection of Parkinson's disease using fuzzy k-nearest neighbor approach , 2013, Expert Syst. Appl..

[76]  E. Burnside,et al.  Long-term Outcomes and Cost-effectiveness of Breast Cancer Screening with Digital Breast Tomosynthesis in the United States. , 2019, Journal of the National Cancer Institute.

[77]  Lufeng Hu,et al.  An efficient machine learning approach for diagnosis of paraquat-poisoned patients , 2015, Comput. Biol. Medicine.

[78]  Ümit Budak,et al.  Transfer learning based histopathologic image classification for breast cancer detection , 2018, Health Information Science and Systems.

[79]  Huiling Chen,et al.  Chaotic multi-swarm whale optimizer boosted support vector machine for medical diagnosis , 2020, Appl. Soft Comput..

[80]  Yaoqin Xie,et al.  Breast mass lesion classification in mammograms by transfer learning , 2017, BIOINFORMATICS 2017.

[81]  Huiling Chen,et al.  An Effective Computational Model for Bankruptcy Prediction Using Kernel Extreme Learning Machine Approach , 2017 .

[82]  Nadhir Al-Ansari,et al.  Influence of Data Splitting on Performance of Machine Learning Models in Prediction of Shear Strength of Soil , 2021 .

[83]  Yalin Wang,et al.  Morphological changes in subregions of hippocampus and amygdala in major depressive disorder patients , 2018, Brain Imaging and Behavior.

[84]  Xiaogang Jin,et al.  Structure-Aware Nonlocal Optimization Framework for Image Colorization , 2015, Journal of Computer Science and Technology.

[85]  Xuehua Zhao,et al.  Evaluation of Sino Foreign Cooperative Education Project Using Orthogonal Sine Cosine Optimized Kernel Extreme Learning Machine , 2020, IEEE Access.

[86]  Qaisar Abbas,et al.  DeepCAD: A Computer-Aided Diagnosis System for Mammographic Masses Using Deep Invariant Features , 2016, Comput..

[87]  Hui Huang,et al.  Interactive image recoloring by combining global and local optimization , 2015, Multimedia Tools and Applications.

[88]  Asral Bahari Jambek,et al.  A study on image processing using mathematical morphological , 2016, 2016 3rd International Conference on Electronic Design (ICED).

[89]  Zhennao Cai,et al.  A new machine-learning method to prognosticate paraquat poisoned patients by combining coagulation, liver, and kidney indices , 2017, PloS one.

[90]  Wenshu Li,et al.  Improved Butterfly Optimizer-Configured Extreme Learning Machine for Fault Diagnosis , 2021, Complex..

[91]  Dong Liu,et al.  Medical image classification using spatial adjacent histogram based on adaptive local binary patterns , 2016, Comput. Biol. Medicine.

[92]  Guoying Zhao,et al.  Sparse tensor canonical correlation analysis for micro-expression recognition , 2016, Neurocomputing.

[93]  Xiaogang Jin,et al.  Efficient image decolorization with a multimodal contrast-preserving measure , 2018, Comput. Graph..

[94]  Kun Zhou,et al.  Parallel Style-Aware Image Cloning for Artworks , 2015, IEEE Transactions on Visualization and Computer Graphics.

[95]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[96]  Pengjun Wang,et al.  A New Hybrid Machine Learning Approach for Prediction of Phenanthrene Toxicity on Mice , 2019, IEEE Access.

[97]  Jianhua Gu,et al.  A New Hybrid Intelligent Framework for Predicting Parkinson’s Disease , 2017, IEEE Access.

[98]  Geoffrey E. Hinton,et al.  On the importance of initialization and momentum in deep learning , 2013, ICML.

[99]  Wenhan Luo,et al.  Video Deblurring via Spatiotemporal Pyramid Network and Adversarial Gradient Prior , 2021, Comput. Vis. Image Underst..

[100]  Xiaogang Jin,et al.  Mathematical Marbling , 2012, IEEE Computer Graphics and Applications.

[101]  Changfei Tong,et al.  An intelligent prognostic system for analyzing patients with paraquat poisoning using arterial blood gas indexes. , 2017, Journal of pharmacological and toxicological methods.

[102]  Hui Huang,et al.  Developing a new intelligent system for the diagnosis of tuberculous pleural effusion , 2018, Comput. Methods Programs Biomed..

[103]  Xuehua Zhao,et al.  An Effective Machine Learning Approach for Identifying the Glyphosate Poisoning Status in Rats Using Blood Routine Test , 2018, IEEE Access.

[104]  Ning Qian,et al.  On the momentum term in gradient descent learning algorithms , 1999, Neural Networks.

[105]  Huiling Chen,et al.  Crow Search Algorithm: Theory, Recent Advances, and Applications , 2020, IEEE Access.

[106]  Jiawei Han,et al.  Selection of interdependent genes via dynamic relevance analysis for cancer diagnosis , 2013, J. Biomed. Informatics.

[107]  Fausto Giunchiglia,et al.  Deep Feature-Based Text Clustering and its Explanation , 2022, IEEE Transactions on Knowledge and Data Engineering.

[108]  Yu-Hsin Chen,et al.  Measuring dynamic micro-expressions via feature extraction methods , 2017, J. Comput. Sci..

[109]  Li Zhao,et al.  Self-filtering image dehazing with self-supporting module , 2021, Neurocomputing.

[110]  Liang Du,et al.  Unsupervised feature selection for balanced clustering , 2020, Knowl. Based Syst..

[111]  Samir Elmougy,et al.  Big-Data Aggregating, Linking, Integrating and Representing Using Semantic Web Technologies , 2018, AMLTA.

[112]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[114]  Shuhui Wang,et al.  A minimum entropy deconvolution-enhanced convolutional neural networks for fault diagnosis of axial piston pumps , 2019, Soft Computing.

[115]  Wenhan Luo,et al.  Multi-Level Fusion and Attention-Guided CNN for Image Dehazing , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[116]  Lorenzo Bruzzone,et al.  Superpixel-Based Unsupervised Band Selection for Classification of Hyperspectral Images , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[117]  Xia Wu,et al.  Altered Time-Frequency Feature in Default Mode Network of Autism Based on Improved Hilbert-Huang Transform , 2020, IEEE Journal of Biomedical and Health Informatics.

[118]  Qiang Gao,et al.  A multi-sensor fault detection strategy for axial piston pump using the Walsh transform method , 2018, Int. J. Distributed Sens. Networks.

[119]  Li Zhao,et al.  Robust feature learning for adversarial defense via hierarchical feature alignment , 2021, Inf. Sci..

[120]  Kok-Swee Sim,et al.  Convolutional neural network improvement for breast cancer classification , 2019, Expert Syst. Appl..

[121]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[122]  Xiaogang Jin,et al.  Real-time image marbleization , 2012, Multimedia Tools and Applications.