Improved Breast Cancer Classification Through Combining Graph Convolutional Network and Convolutional Neural Network

Abstract Aim In a pilot study to improve detection of malignant lesions in breast mammograms, we aimed to develop a new method called BDR-CNN-GCN, combining two advanced neural networks: (i) graph convolutional network (GCN); and (ii) convolutional neural network (CNN). Method We utilised a standard 8-layer CNN, then integrated two improvement techniques: (i) batch normalization (BN) and (ii) dropout (DO). Finally, we utilized rank-based stochastic pooling (RSP) to substitute the traditional max pooling. This resulted in BDR-CNN, which is a combination of CNN, BN, DO, and RSP. This BDR-CNN was hybridized with a two-layer GCN, and yielded our BDR-CNN-GCN model which was then utilized for analysis of breast mammograms as a 14-way data augmentation method. Results As proof of concept, we ran our BDR-CNN-GCN algorithm 10 times on the breast mini-MIAS dataset (containing 322 mammographic images), achieving a sensitivity of 96.20±2.90%, a specificity of 96.00±2.31% and an accuracy of 96.10±1.60%. Conclusion Our BDR-CNN-GCN showed improved performance compared to five proposed neural network models and 15 state-of-the-art breast cancer detection approaches, proving to be an effective method for data augmentation and improved detection of malignant breast masses.

[1]  Juan Manuel Górriz,et al.  Covid-19 classification by FGCNet with deep feature fusion from graph convolutional network and convolutional neural network , 2020, Information Fusion.

[2]  Yudong Zhang,et al.  Abnormal breast identification by nine-layer convolutional neural network with parametric rectified linear unit and rank-based stochastic pooling , 2018, J. Comput. Sci..

[3]  Kazushi Ikeda,et al.  Theoretical analysis of skip connections and batch normalization from generalization and optimization perspectives , 2020, APSIPA Transactions on Signal and Information Processing.

[4]  Zheng Zhang,et al.  Generalized Incomplete Multiview Clustering With Flexible Locality Structure Diffusion , 2020, IEEE Transactions on Cybernetics.

[5]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[6]  Huimin Lu,et al.  Wavelet energy entropy and linear regression classifier for detecting abnormal breasts , 2018, Multimedia Tools and Applications.

[7]  Banshidhar Majhi,et al.  Deep extreme learning machine with leaky rectified linear unit for multiclass classification of pathological brain images , 2019, Multimedia Tools and Applications.

[8]  Yudong Zhang,et al.  Smart detection on abnormal breasts in digital mammography based on contrast-limited adaptive histogram equalization and chaotic adaptive real-coded biogeography-based optimization , 2016, Simul..

[9]  Heng Tao Shen,et al.  Heterogeneous data fusion for predicting mild cognitive impairment conversion , 2021, Inf. Fusion.

[10]  Jaehyun Lee,et al.  Day-Ahead Electric Load Forecasting for the Residential Building with a Small-Size Dataset Based on a Self-Organizing Map and a Stacking Ensemble Learning Method , 2019, Applied Sciences.

[11]  Ling Shao,et al.  Binary Multi-View Clustering , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Hua Hu,et al.  Advances in multimodal data fusion in neuroimaging: Overview, challenges, and novel orientation , 2020, Information Fusion.

[13]  Yangdong Ye,et al.  Rank-based pooling for deep convolutional neural networks , 2016, Neural Networks.

[14]  Lin Jiang,et al.  Breast Cancer Detection Via Wavelet Energy and Support Vector Machine , 2018, 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[15]  Francisco Herrera,et al.  Artificial intelligence within the interplay between natural and artificial computation: Advances in data science, trends and applications , 2020, Neurocomputing.

[16]  Ahmet Sertbas,et al.  Computer‐aided classification of breast masses in mammogram images based on spherical wavelet transform and support vector machines , 2015, Expert Syst. J. Knowl. Eng..

[17]  Ling Shao,et al.  Discriminative Fisher Embedding Dictionary Learning Algorithm for Object Recognition , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Charu C. Aggarwal,et al.  Epidemic Graph Convolutional Network , 2020, WSDM.

[19]  Aishan Wumaier,et al.  Named-Entity Recognition in Sports Field Based on a Character-Level Graph Convolutional Network , 2020, Inf..

[20]  Ke Wang,et al.  Cost-Sensitive Learning to Rank , 2019, AAAI.

[21]  Zi Huang,et al.  Inductive Structure Consistent Hashing via Flexible Semantic Calibration , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[23]  Nianyin Zeng,et al.  Utilization of DenseNet201 for diagnosis of breast abnormality , 2019, Machine Vision and Applications.

[24]  Mohammed A. Fadhel,et al.  Optimizing the Performance of Breast Cancer Classification by Employing the Same Domain Transfer Learning from Hybrid Deep Convolutional Neural Network Model , 2020, Electronics.

[25]  Lubomir M. Hadjiiski,et al.  Generalization error analysis for deep convolutional neural network with transfer learning in breast cancer diagnosis , 2020, Physics in medicine and biology.

[26]  Fangyuan Liu,et al.  Breast Cancer Recognition by Support Vector Machine Combined with Daubechies Wavelet Transform and Principal Component Analysis , 2018, Proceedings of the International Conference on ISMAC in Computational Vision and Bio-Engineering 2018 (ISMAC-CVB).

[27]  Yoshihiro Yamanishi,et al.  Prediction of the Health Effects of Food Peptides and Elucidation of the Mode‐of‐action Using Multi‐task Graph Convolutional Neural Network , 2019, Molecular informatics.

[28]  Ming Yang,et al.  Sensorineural hearing loss identification via nine-layer convolutional neural network with batch normalization and dropout , 2018, Multimedia Tools and Applications.

[29]  Yuanyuan Wang,et al.  Deep learning radiomics can predict axillary lymph node status in early-stage breast cancer , 2020, Nature Communications.

[30]  Zi Huang,et al.  Graph-Based Relation-Aware Representation Learning for Clothing Matching , 2020, ADC.

[31]  Christoph Meinel,et al.  Deep Neural Network with l2-Norm Unit for Brain Lesions Detection , 2017, ICONIP.

[32]  Zi Huang,et al.  Scalable Supervised Asymmetric Hashing With Semantic and Latent Factor Embedding , 2019, IEEE Transactions on Image Processing.

[33]  Xiaohong Zhang,et al.  A Fast Method for Estimating the Number of Clusters Based on Score and the Minimum Distance of the Center Point , 2020, Inf..

[34]  Dragan Jankovic,et al.  Comparative analysis of breast cancer detection in mammograms and thermograms , 2015, Biomedizinische Technik. Biomedical engineering.

[35]  Fangyuan Liu,et al.  Abnormal Breast Detection Via Combination of Particle Swarm Optimization and Biogeography-Based Optimization , 2017 .

[36]  R. Udendhran,et al.  Hybridized neural network and decision tree based classifier for prognostic decision making in breast cancers , 2020, Soft Comput..

[37]  Social Determinants of Breast Cancer Screening among Married Women: A Cross-Sectional Study , 2020, Journal of research in health sciences.

[38]  Shih-Neng Yang,et al.  Identification of Breast Cancer Using Integrated Information from MRI and Mammography , 2015, PloS one.

[39]  Oge Marques,et al.  Dropout vs. batch normalization: an empirical study of their impact to deep learning , 2020, Multimedia Tools and Applications.

[40]  Praveen Sankaran,et al.  Computer assisted recognition of breast cancer in biopsy images via fusion of nucleus-guided deep convolutional features , 2020, Comput. Methods Programs Biomed..

[41]  D. Miglioretti,et al.  Screening mammography outcomes: risk of breast cancer and mortality by comorbidity score and age. , 2019, Journal of the National Cancer Institute.

[42]  Zhiguo Jiang,et al.  Graph Convolutional Networks for Cervical Cell Classification , 2019 .

[43]  Aijun Liu,et al.  Abnormal Breast Detection in Mammogram Images by Feed-forward Neural Network Trained by Jaya Algorithm , 2017, Fundam. Informaticae.

[44]  Shuihua Wang,et al.  Computer-aided diagnosis of abnormal breasts in mammogram images by weighted-type fractional Fourier transform , 2016 .