Breast Cancer Classification from Histopathological Images Using Transfer Learning and Deep Neural Networks

Early diagnosis of breast cancer is the most reliable and practical approach to managing cancer. Computer-aided detection or computer-aided diagnosis is one of the software technology designed to assist doctors in detecting or diagnose cancer and reduce mortality via using the medical image analysis with less time. Recently, medical image analysis used Convolution Neural Networks to evaluate a vast number of data to detect cancer cells or image classification. In this thesis, we implemented transfer learning from pre-trained deep neural networks ResNet18, Inception-V3Net, and ShuffleNet in terms of binary classification and multiclass classification for breast cancer from histopathological images. We use transfer learning with the fine-tuned network results in much faster and less complicated training than a training network with randomly initialized weights from scratch. Our approach is applied to image-based breast cancer classification using histopathological images from public dataset BreakHis. The highest average accuracy achieved for binary classification of benign or malignant cases was 97.11% for ResNet 18, followed by 96.78% for ShuffleNet and 95.65% for Inception-V3Net. In terms of the multiclass classification of eight cancer classes, the average accuracies for pre-trained networks are as follows. ResNet18 achieved 94.17%, Inception-V3Net 92.76% and ShuffleNet 92.27%.

[1]  H. Bartsch,et al.  International Agency for Research on Cancer. , 1969, WHO chronicle.

[2]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[3]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[4]  M. Brock,et al.  The use of “overall accuracy” to evaluate the validity of screening or diagnostic tests , 2004, Journal of General Internal Medicine.

[5]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[6]  J. S. Marron,et al.  A method for normalizing histology slides for quantitative analysis , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[7]  Yann LeCun,et al.  Convolutional networks and applications in vision , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[8]  Marc'Aurelio Ranzato,et al.  Fast Inference in Sparse Coding Algorithms with Applications to Object Recognition , 2010, ArXiv.

[9]  Jin Xu,et al.  Detection of granularity in dermoscopy images of malignant melanoma using color and texture features , 2011, Comput. Medical Imaging Graph..

[10]  Marc Sebban,et al.  Discriminative feature fusion for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Luca Maria Gambardella,et al.  Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks , 2013, MICCAI.

[12]  Fabio A. González,et al.  Automatic detection of invasive ductal carcinoma in whole slide images with convolutional neural networks , 2014, Medical Imaging.

[13]  Jorge S. Marques,et al.  Two Systems for the Detection of Melanomas in Dermoscopy Images Using Texture and Color Features , 2014, IEEE Systems Journal.

[14]  Hai Su,et al.  Region segmentation in histopathological breast cancer images using deep convolutional neural network , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[15]  E. Valuations,et al.  A R EVIEW ON E VALUATION M ETRICS F OR D ATA C LASSIFICATION E VALUATIONS , 2015 .

[16]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[17]  Yudong Zhang,et al.  Magnetic resonance brain image classification based on weighted‐type fractional Fourier transform and nonparallel support vector machine , 2015, Int. J. Imaging Syst. Technol..

[18]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Luiz Eduardo Soares de Oliveira,et al.  Breast cancer histopathological image classification using Convolutional Neural Networks , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[21]  Luiz Eduardo Soares de Oliveira,et al.  A Dataset for Breast Cancer Histopathological Image Classification , 2016, IEEE Transactions on Biomedical Engineering.

[22]  Juho Kannala,et al.  Deep learning for magnification independent breast cancer histopathology image classification , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[23]  Catarina Eloy,et al.  Classification of breast cancer histology images using Convolutional Neural Networks , 2017, PloS one.

[24]  Luiz Eduardo Soares de Oliveira,et al.  Deep features for breast cancer histopathological image classification , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[25]  Taysir Hassan A. Soliman,et al.  Multi-Class Breast Cancer Classification using Deep Learning Convolutional Neural Network , 2018 .

[26]  Sumit Agarwal,et al.  Grading Tumor Malignancy via Deep Bidirectional LSTM on Graph Manifold Encoded Histopathological Image , 2018, 2018 IEEE International Conference on Data Mining Workshops (ICDMW).

[27]  R. Saravanan,et al.  Comparison of Deep Feature Classification and Fine Tuning for Breast Cancer Histopathology Image Classification , 2018, RTIP2R.

[28]  Arnav Bhavsar,et al.  Sequential Modeling of Deep Features for Breast Cancer Histopathological Image Classification , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[29]  Taysir Hassan A. Soliman,et al.  Automated Classification of Breast Cancer Histology Images Using Deep Learning Based Convolutional Neural Networks , 2018 .

[30]  Pendar Alirezazadeh,et al.  Representation learning-based unsupervised domain adaptation for classification of breast cancer histopathology images , 2018 .

[31]  Rajesh Mehra,et al.  Breast cancer histology images classification: Training from scratch or transfer learning? , 2018, ICT Express.

[32]  Nidhi Mishra,et al.  Breast cancer diagnosis using adaptive voting ensemble machine learning algorithm , 2018, 2018 IEEMA Engineer Infinite Conference (eTechNxT).

[33]  Xiangyu Zhang,et al.  ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[34]  Jianping Qiao,et al.  Multivariate Deep Learning Classification of Alzheimer’s Disease Based on Hierarchical Partner Matching Independent Component Analysis , 2018, Front. Aging Neurosci..

[35]  Ziba Gandomkar,et al.  MuDeRN: Multi-category classification of breast histopathological image using deep residual networks , 2018, Artif. Intell. Medicine.

[36]  Steve A. Adeshina,et al.  Breast Cancer Histopathology Image Classification with Deep Convolutional Neural Networks , 2018, 2018 14th International Conference on Electronics Computer and Computation (ICECCO).

[37]  Kai Zhang,et al.  Deep learning for image-based cancer detection and diagnosis - A survey , 2018, Pattern Recognit..

[38]  Adam Krzyzak,et al.  Mass detection in digital breast tomosynthesis data using convolutional neural networks and multiple instance learning , 2018, Comput. Biol. Medicine.

[39]  Mehran Yazdi,et al.  Heterogeneity-Aware Local Binary Patterns for Retrieval of Histopathology Images , 2019, IEEE Access.

[40]  Qi Qi,et al.  Label-Efficient Breast Cancer Histopathological Image Classification , 2019, IEEE Journal of Biomedical and Health Informatics.

[41]  Qiaoying Huang,et al.  Deep Attentive Feature Learning for Histopathology Image Classification , 2019, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[42]  Kevin A. Schneider,et al.  Breast Cancer Diagnosis with Transfer Learning and Global Pooling , 2019, 2019 International Conference on Information and Communication Technology Convergence (ICTC).

[43]  Rajesh Mehra,et al.  Effect of layer-wise fine-tuning in magnification-dependent classification of breast cancer histopathological image , 2019, The Visual Computer.

[44]  Mita Nasipuri,et al.  Patch-based system for Classification of Breast Histology images using deep learning , 2019, Comput. Medical Imaging Graph..

[45]  Saiful Islam,et al.  Cancer diagnosis in histopathological image: CNN based approach , 2019, Informatics in Medicine Unlocked.

[46]  Lin Cong,et al.  Breast Cancer Diagnosis from Histopathological Image based on Deep Learning , 2019, 2019 Chinese Control And Decision Conference (CCDC).

[47]  Ying Wang,et al.  Breast cancer histopathology image classification through assembling multiple compact CNNs , 2019, BMC Medical Informatics and Decision Making.

[48]  Yun Jiang,et al.  Breast cancer histopathological image classification using convolutional neural networks with small SE-ResNet module , 2019, PloS one.

[49]  Mario Coccia,et al.  Deep Learning Technology for Improving Cancer Care in Society: New Directions in Cancer Imaging Driven by Artificial Intelligence , 2019 .

[50]  Yun Gu,et al.  Multi-level magnification correlation hashing for scalable histopathological image retrieval , 2019, Neurocomputing.

[51]  Shamim Ripon,et al.  Transfer Learning and Supervised Classifier Based Prediction Model for Breast Cancer , 2019 .

[52]  Jie Yang,et al.  Densely-Connected Multi-Magnification Hashing for Histopathological Image Retrieval , 2019, IEEE Journal of Biomedical and Health Informatics.

[53]  Vijayan K. Asari,et al.  Breast Cancer Classification from Histopathological Images with Inception Recurrent Residual Convolutional Neural Network , 2018, Journal of Digital Imaging.

[54]  Peyman Hosseinzadeh Kassani,et al.  A comparative study of deep learning architectures on melanoma detection. , 2019, Tissue & cell.

[55]  Kevin A. Schneider,et al.  Classification of Histopathological Biopsy Images Using Ensemble of Deep Learning Networks , 2019, CASCON.

[56]  Catalin Stoean,et al.  Cancer diagnosis through a tandem of classifiers for digitized histopathological slides , 2019, PloS one.

[57]  D. Koundal,et al.  Recent Trends in Computer Assisted Diagnosis (CAD) System for Breast Cancer Diagnosis Using Histopathological Images , 2019, IRBM.

[58]  Luiz Eduardo Soares de Oliveira,et al.  Multiple instance learning for histopathological breast cancer image classification , 2019, Expert Syst. Appl..

[59]  Phu T. Nguyen,et al.  Multiclass Breast Cancer Classification Using Convolutional Neural Network , 2019, 2019 International Symposium on Electrical and Electronics Engineering (ISEE).

[60]  Yanning Zhang,et al.  EMS-Net: Ensemble of Multiscale Convolutional Neural Networks for Classification of Breast Cancer Histology Images , 2019, Neurocomputing.

[61]  Chaoyang Zhang,et al.  Deep Learning Based Analysis of Histopathological Images of Breast Cancer , 2019, Front. Genet..

[62]  Zafer Cömert,et al.  Computer-aided diagnosis system combining FCN and Bi-LSTM model for efficient breast cancer detection from histopathological images , 2019, Appl. Soft Comput..

[63]  Xiaotong Liu,et al.  Classifying Breast Cancer Histopathological Images Using a Robust Artificial Neural Network Architecture , 2019, IWBBIO.

[64]  Ali Aghagolzadeh,et al.  Ensemble of CNN for multi-focus image fusion , 2019, Inf. Fusion.

[65]  Alessandro L. Koerich,et al.  Texture CNN for Histopathological Image Classification , 2019, CBMS.

[66]  K. Bora,et al.  Comparative assessment of CNN architectures for classification of breast FNAC images. , 2019, Tissue & cell.

[67]  Basit Raza,et al.  Multi-View Feature Fusion Based Four Views Model for Mammogram Classification Using Convolutional Neural Network , 2019, IEEE Access.

[68]  Mesut Toğaçar,et al.  Application of breast cancer diagnosis based on a combination of convolutional neural networks, ridge regression and linear discriminant analysis using invasive breast cancer images processed with autoencoders. , 2019, Medical hypotheses.

[69]  N. Ismail,et al.  Breast Cancer Detection Based on Deep Learning Technique , 2019, 2019 International UNIMAS STEM 12th Engineering Conference (EnCon).

[70]  Sang-Woong Lee,et al.  Classification of breast cancer histology images using incremental boosting convolution networks , 2019, Inf. Sci..

[71]  Yashwant Kurmi,et al.  Tumor Malignancy Detection Using Histopathology Imaging. , 2019, Journal of medical imaging and radiation sciences.

[72]  Zafer Cömert,et al.  BreastNet: A novel convolutional neural network model through histopathological images for the diagnosis of breast cancer , 2020 .

[73]  Hehua Zhang,et al.  Cross-task extreme learning machine for breast cancer image classification with deep convolutional features , 2020, Biomed. Signal Process. Control..

[74]  Arun Kumar Sangaiah,et al.  Deep feature learning for histopathological image classification of canine mammary tumors and human breast cancer , 2020, Inf. Sci..

[75]  Hyunsoo Yoon,et al.  A Feature Transfer Enabled Multi-Task Deep Learning Model on Medical Imaging , 2019, Expert Syst. Appl..

[76]  Lahouari Ghouti,et al.  A fully-automated deep learning pipeline for cervical cancer classification , 2020, Expert Syst. Appl..

[77]  Muhammad Kashif,et al.  Application of machine learning and image processing for detection of breast cancer , 2020 .

[78]  David S. Melnick,et al.  International evaluation of an AI system for breast cancer screening , 2020, Nature.

[79]  Aditi Sakalle,et al.  Unbalanced breast cancer data classification using novel fitness functions in genetic programming , 2020, Expert Syst. Appl..

[80]  Francisco Herrera,et al.  BreakHis based breast cancer automatic diagnosis using deep learning: Taxonomy, survey and insights , 2020, Neurocomputing.