Breast Cancer Classification From Histopathological Images Using Patch-Based Deep Learning Modeling

Accurate detection and classification of breast cancer is a critical task in medical imaging due to the complexity of breast tissues. Due to automatic feature extraction ability, deep learning methods have been successfully applied in different areas, especially in the field of medical imaging. In this study, a novel patch-based deep learning method called Pa-DBN-BC is proposed to detect and classify breast cancer on histopathology images using the Deep Belief Network (DBN). Features are extracted through an unsupervised pre-training and supervised fine-tuning phase. The network automatically extracts features from image patches. Logistic regression is used to classify the patches from histopathology images. The features extracted from the patches are fed to the model as input and the model presents the result as a probability matrix as either a positive sample (cancer) or a negative sample (background). The proposed model is trained and tested on the whole slide histopathology image dataset having images from four different data cohorts and achieved an accuracy of 86%. Consequently, the proposed method is better than the traditional ones, as it automatically learns the best possible features and experimental results show that the model outperformed the previously proposed deep learning methods.

[1]  Edward Y. Chang,et al.  Transfer representation learning for medical image analysis , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[2]  Fabio A. González,et al.  Automatic detection of invasive ductal carcinoma in whole slide images with convolutional neural networks , 2014, Medical Imaging.

[3]  Antonio Torralba,et al.  SoundNet: Learning Sound Representations from Unlabeled Video , 2016, NIPS.

[4]  Ashraf Osman Ibrahim,et al.  Intelligent Breast Cancer Diagnosis Based on Enhanced Pareto Optimal and Multilayer Perceptron Neural Network , 2018, Int. J. Comput. Aided Eng. Technol..

[5]  Narit Hnoohom,et al.  Thai fast food image classification using deep learning , 2018, 2018 International ECTI Northern Section Conference on Electrical, Electronics, Computer and Telecommunications Engineering (ECTI-NCON).

[6]  Nassir Navab,et al.  Automated malignancy detection in breast histopathological images , 2012, Medical Imaging.

[7]  El-Sayed M. El-Horbaty,et al.  Classification using deep learning neural networks for brain tumors , 2017, Future Computing and Informatics Journal.

[8]  Václav Snásel,et al.  Thermogram breast cancer prediction approach based on Neutrosophic sets and fuzzy c-means algorithm , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[9]  Nilanjan Dey,et al.  Adaptive Semi Supervised Support Vector Machine Semi Supervised Learning with Features Cooperation for Breast Cancer Classification , 2016 .

[10]  Hayit Greenspan,et al.  A multi-view deep learning architecture for classification of breast microcalcifications , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[11]  Aniati Murni Arymurthy,et al.  Batik Classification using Deep Convolutional Network Transfer Learning , 2018 .

[12]  Geoffrey E. Hinton,et al.  3D Object Recognition with Deep Belief Nets , 2009, NIPS.

[13]  Bram van Ginneken,et al.  Pulmonary Nodule Detection in CT Images: False Positive Reduction Using Multi-View Convolutional Networks , 2016, IEEE Transactions on Medical Imaging.

[14]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Yongtian Wang,et al.  Deep Belief Network Modeling for Automatic Liver Segmentation , 2019, IEEE Access.

[16]  Mubashir Ahmad,et al.  Deep Belief Network Based Vertebra Segmentation for CT Images , 2018, IGTA.

[17]  Nadine Hajj,et al.  Deep belief networks and cortical algorithms: A comparative study for supervised classification , 2019, Applied Computing and Informatics.

[18]  A. Chetlen,et al.  Breast cancer screening controversies: who, when, why, and how? , 2016, Clinical imaging.

[19]  A. Jemal,et al.  Cancer statistics, 2019 , 2019, CA: a cancer journal for clinicians.

[20]  Khalid M. Hosny,et al.  Skin Cancer Classification using Deep Learning and Transfer Learning , 2018, 2018 9th Cairo International Biomedical Engineering Conference (CIBEC).

[21]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.

[22]  N. Razavian,et al.  Classification and mutation prediction from non–small cell lung cancer histopathology images using deep learning , 2018, Nature Medicine.

[23]  Nan Wu,et al.  Deep Neural Networks Improve Radiologists’ Performance in Breast Cancer Screening , 2019, IEEE Transactions on Medical Imaging.

[24]  U. Rajendra Acharya,et al.  Application of deep transfer learning for automated brain abnormality classification using MR images , 2019, Cognitive Systems Research.

[25]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Gustavo Carneiro,et al.  A deep learning approach for the analysis of masses in mammograms with minimal user intervention , 2017, Medical Image Anal..

[27]  Nico Karssemeijer,et al.  Optimizing Case-Based Detection Performance in a Multiview CAD System for Mammography , 2011, IEEE Transactions on Medical Imaging.

[28]  Aytürk Keles,et al.  Expert system based on neuro-fuzzy rules for diagnosis breast cancer , 2011, Expert Syst. Appl..

[29]  C. Mathers,et al.  Cancer incidence and mortality worldwide: Sources, methods and major patterns in GLOBOCAN 2012 , 2015, International journal of cancer.

[30]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[31]  Catarina Eloy,et al.  Classification of breast cancer histology images using Convolutional Neural Networks , 2017, PloS one.

[32]  Yadollahpour Ali,et al.  Early Breast Cancer Detection using Mammogram Images: A Review of Image Processing Techniques , 2015 .

[33]  Fa Zhang,et al.  Breast cancer histopathological image classification using a hybrid deep neural network. , 2020, Methods.

[34]  Daisuke Komura,et al.  Machine Learning Methods for Histopathological Image Analysis , 2017, Computational and structural biotechnology journal.

[35]  Yasser M. Kadah,et al.  An Automatic Computer-Aided Diagnosis System for Breast Cancer in Digital Mammograms via Deep Belief Network , 2018 .

[36]  Mubashir Ahmad,et al.  Vertebrae segmentation via stacked sparse autoencoder from computed tomography images , 2019, International Conference on Digital Image Processing.

[37]  D. Shen,et al.  Computer-Aided Diagnosis with Deep Learning Architecture: Applications to Breast Lesions in US Images and Pulmonary Nodules in CT Scans , 2016, Scientific Reports.

[38]  Chenming Li,et al.  Deep Belief Network for Spectral–Spatial Classification of Hyperspectral Remote Sensor Data , 2019, Sensors.

[39]  H. Iwase,et al.  [Breast cancer]. , 2006, Nihon rinsho. Japanese journal of clinical medicine.

[40]  Qingzeng Song,et al.  Using Deep Learning for Classification of Lung Nodules on Computed Tomography Images , 2017, Journal of healthcare engineering.

[41]  Vivek Kumar Singh,et al.  Breast Cancer Detection Using K-Nearest Neighbors, Logistic Regression and Ensemble Learning , 2020, 2020 International Conference on Electronics and Sustainable Communication Systems (ICESC).

[42]  Zhijun Hu,et al.  Multi-View Convolutional Neural Networks for Mammographic Image Classification , 2019, IEEE Access.

[43]  Keijo Haataja,et al.  Computer-aided breast cancer histopathological diagnosis: Comparative analysis of three DTOCS-based features: SW-DTOCS, SW-WDTOCS and SW-3-4-DTOCS , 2014, 2014 4th International Conference on Image Processing Theory, Tools and Applications (IPTA).

[44]  Feng Liu,et al.  Deep Learning and Its Applications in Biomedicine , 2018, Genom. Proteom. Bioinform..

[45]  Stanislas Chambon,et al.  A Deep Learning Architecture for Temporal Sleep Stage Classification Using Multivariate and Multimodal Time Series , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[46]  Xiaogang Wang,et al.  Deep Learning Face Attributes in the Wild , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[47]  Xiaolong Wang,et al.  Active Deep Networks for Semi-Supervised Sentiment Classification , 2010, COLING.

[48]  C. von Wagner,et al.  Typical and atypical presenting symptoms of breast cancer and their associations with diagnostic intervals: Evidence from a national audit of cancer diagnosis , 2017, Cancer epidemiology.

[49]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[50]  Siti Mariyam Shamsuddin,et al.  Deep Layer CNN Architecture for Breast Cancer Histopathology Image Detection , 2019, AMLTA.

[51]  David Zhang,et al.  A Survey of Sparse Representation: Algorithms and Applications , 2015, IEEE Access.

[52]  Xiahai Zhuang,et al.  Statistical Atlases and Computational Models of the Heart. ACDC and MMWHS Challenges , 2017, Lecture Notes in Computer Science.

[53]  Victor Alves,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images , 2016, IEEE Transactions on Medical Imaging.

[54]  Shahrokh Asadi,et al.  An evolutionary deep belief network extreme learning-based for breast cancer diagnosis , 2019, Soft Comput..

[55]  Lisa Tang,et al.  Deep 3D Convolutional Encoder Networks With Shortcuts for Multiscale Feature Integration Applied to Multiple Sclerosis Lesion Segmentation , 2016, IEEE Transactions on Medical Imaging.

[56]  U. Rajendra Acharya,et al.  A new approach for arrhythmia classification using deep coded features and LSTM networks , 2019, Comput. Methods Programs Biomed..

[57]  Kemal Polat,et al.  A Novel ML Approach to Prediction of Breast Cancer: Combining of mad normalization, KMC based feature weighting and AdaBoostM1 classifier , 2018, 2018 2nd International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT).

[58]  Mubashir Ahmad,et al.  Deep-Stacked Auto Encoder for Liver Segmentation , 2017, IGTA.

[59]  Kok-Swee Sim,et al.  Convolutional neural network improvement for breast cancer classification , 2019, Expert Syst. Appl..

[60]  Nico Karssemeijer,et al.  Improved mammographic CAD performance using multi-view information: a Bayesian network framework , 2009, Physics in medicine and biology.

[61]  Mussarat Yasmin,et al.  Survey Paper on Diagnosis of Breast Cancer Using Image Processing Techniques , 2013 .

[62]  Hien Thi-Thu Pham,et al.  Breast Cancer Histopathological Image Classification Utilizing Convolutional Neural Network , 2018, IFMBE Proceedings.

[63]  Yun Tian,et al.  Automatic Whole Heart Segmentation Using a Two-Stage U-Net Framework and an Adaptive Threshold Window , 2019, IEEE Access.

[64]  B. Milović,et al.  Prediction and Decision Making in Health Care using Data Mining , 2012 .

[65]  Ayman M. Eldeib,et al.  Breast cancer classification using deep belief networks , 2016, Expert Syst. Appl..

[66]  Seong-Whan Lee,et al.  Hierarchical feature representation and multimodal fusion with deep learning for AD/MCI diagnosis , 2014, NeuroImage.

[67]  Christian Igel,et al.  An Introduction to Restricted Boltzmann Machines , 2012, CIARP.

[68]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[69]  Jian Yang,et al.  Automatic Deep Feature Learning via Patch-Based Deep Belief Network for Vertebrae Segmentation in CT Images , 2018, Applied Sciences.

[70]  Boyu Wang,et al.  X-Ray Scattering Image Classification Using Deep Learning , 2016, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[71]  Waqas Anjum,et al.  Modern Breast Cancer Detection: A Technological Review , 2009, Int. J. Biomed. Imaging.