A new transfer learning based approach to magnification dependent and independent classification of breast cancer in histopathological images

Abstract The visual analysis of histopathological images is the gold standard for diagnosing breast cancer, yet a strenuous and an intricate task that requires years of pathologist training. Therefore, automating this task using computer-aided diagnosis (CAD) is highly expected. This paper proposes a new transfer learning-based approach to automated classification of breast cancer from histopathological images, including magnification dependent (MD) and magnification independent (MI) binary and eight-class classifications. We apply the deep neural network ResNet-18 to this problem, which is pre-trained on ImageNet, a large dataset of common images. We then design our transfer learning method to refine the network on histopathological images. Our transfer learning method is based on block-wise fine-tuning strategy; in which we make the last two residual blocks of the deep network model more domain-specific to our target data. It substantially helps to avoid over-fitting and speed up the training. Furthermore, we strengthen the adaptability of the proposed approach by using global contrast normalization (GCN) based on the target’s data values and three-fold data augmentation on training data. The experimental results of MD and MI binary and eight-class classifications on the publicly available BreaKHis dataset demonstrate that our approach is promising and effective, outperforming recent state-of-the-art MD and MI counterparts by a fair margin.

[1]  A. Jemal,et al.  Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries , 2018, CA: a cancer journal for clinicians.

[2]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[3]  Yinan Kong,et al.  Histopathological Breast Cancer Image Classification by Deep Neural Network Techniques Guided by Local Clustering , 2018, BioMed research international.

[4]  Kun Zhang,et al.  Classification of Breast Cancer Based on Histology Images Using Convolutional Neural Networks , 2018, IEEE Access.

[5]  James G. Fujimoto,et al.  Spoke-LBP and ring-LBP: New texture features for tissue classification , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[6]  Sawon Pratiher,et al.  Manifold Learning & Stacked Sparse Autoencoder for Robust Breast Cancer Classification from Histopathological Images , 2018, ArXiv.

[7]  Jae Y. Shin,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE transactions on medical imaging.

[8]  Hala H. Zayed,et al.  Remote Computer-Aided Breast Cancer Detection and Diagnosis System Based on Cytological Images , 2014, IEEE Systems Journal.

[9]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[10]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Rajesh Mehra,et al.  Automatic Magnification Independent Classification of Breast Cancer Tissue in Histological Images Using Deep Convolutional Neural Network , 2018, Communications in Computer and Information Science.

[12]  Lin Cong,et al.  Breast Cancer Diagnosis from Histopathological Image based on Deep Learning , 2019, 2019 Chinese Control And Decision Conference (CCDC).

[13]  Yilong Yin,et al.  Deep learning model based breast cancer histopathological image classification , 2017, 2017 IEEE 2nd International Conference on Cloud Computing and Big Data Analysis (ICCCBDA).

[14]  Yinan Kong,et al.  Histopathological Breast-Image Classification Using Local and Frequency Domains by Convolutional Neural Network , 2018, Inf..

[15]  Luiz Eduardo Soares de Oliveira,et al.  Breast cancer histopathological image classification using Convolutional Neural Networks , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[16]  Juho Kannala,et al.  Deep learning for magnification independent breast cancer histopathology image classification , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[17]  A. Belsare,et al.  Classification of breast cancer histopathology images using texture feature analysis , 2015, TENCON 2015 - 2015 IEEE Region 10 Conference.

[18]  Ron Kimmel,et al.  Breast Cancer Diagnosis From Biopsy Images Using Generic Features and SVMs , 2006 .

[19]  Rajesh Mehra,et al.  Breast cancer histology images classification: Training from scratch or transfer learning? , 2018, ICT Express.

[20]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[21]  Roman Monczak,et al.  Computer-Aided Breast Cancer Diagnosis Based on the Analysis of Cytological Images of Fine Needle Biopsies , 2013, IEEE Transactions on Medical Imaging.

[22]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[23]  U. Wojciechowska,et al.  WHO position paper on mammography screening , 2015 .

[24]  Luiz Eduardo Soares de Oliveira,et al.  Deep features for breast cancer histopathological image classification , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[25]  Luiz Eduardo Soares de Oliveira,et al.  A Dataset for Breast Cancer Histopathological Image Classification , 2016, IEEE Transactions on Biomedical Engineering.

[26]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[27]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..