Deep feature learning for histopathological image classification of canine mammary tumors and human breast cancer

Abstract Canine mammary tumors (CMTs) have high incidences and mortality rates in dogs. They are also considered excellent models for human breast cancer studies. Diagnoses of both, human breast cancer and CMTs, are done by histopathological analysis of haematoxylin and eosin (H&E) stained tissue sections by skilled pathologists: a process that is very tedious and time-consuming. The existence of heterogeneous and diverse types of CMTs and the paucity of skilled veterinary pathologists justify the need for automated diagnosis. Deep learning-based approaches have recently gained popularity for analyzing histopathological images of human breast cancer. However, so far, due to the lack of any publicly available CMT database, no studies have focused on the automated classification of CMTs. To the best of our knowledge, we have introduced for the first time a dataset of CMT histopathological images (CMTHis). Further, we have proposed a framework based on VGGNet-16, and evaluated the performance of the fused framework along with different classifiers on the CMT dataset (CMTHis) and human breast cancer dataset (BreakHis). We also explored the effect of data augmentation, stain normalization, and magnification on the performance of the proposed framework. The proposed framework, with support vector machines, resulted in mean accuracies of 97% and 93% for binary classification of human breast cancer and CMT respectively, which validates the efficacy of the proposed system.

[1]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[2]  Ju Jia Zou,et al.  Adapting fisher vectors for histopathology image classification , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[3]  Hayit Greenspan,et al.  Chest pathology detection using deep learning with non-medical training , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[4]  Shengen Yan,et al.  Deep Image: Scaling up Image Recognition , 2015, ArXiv.

[5]  Ivan Laptev,et al.  Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Chuan Zhou,et al.  Deep Learning in Medical Image Analysis. , 2017, Advances in experimental medicine and biology.

[7]  K. Sorenmo,et al.  Canine mammary gland tumors. , 2003, The Veterinary clinics of North America. Small animal practice.

[8]  Luiz Eduardo Soares de Oliveira,et al.  Multiple instance learning for histopathological breast cancer image classification , 2019, Expert Syst. Appl..

[9]  Yongyi Yang,et al.  Computer-Aided Detection and Diagnosis of Breast Cancer With Mammography: Recent Advances , 2009, IEEE Transactions on Information Technology in Biomedicine.

[10]  Graham W. Taylor,et al.  Adaptive deconvolutional networks for mid and high level feature learning , 2011, 2011 International Conference on Computer Vision.

[11]  V. Zappulli,et al.  Classification and Grading of Canine Mammary Tumors , 2011, Veterinary pathology.

[12]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[13]  Bram van Ginneken,et al.  Automatic classification of pulmonary peri-fissural nodules in computed tomography using an ensemble of 2D views and a convolutional neural network out-of-the-box , 2015, Medical Image Anal..

[14]  Yaritza Salas,et al.  Epidemiological Study of Mammary Tumors in Female Dogs Diagnosed during the Period 2002-2012: A Growing Animal Health Problem , 2015, PloS one.

[15]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[16]  Juho Kannala,et al.  Deep learning for magnification independent breast cancer histopathology image classification , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[17]  J M Cardwell,et al.  The effect of neutering on the risk of mammary tumours in dogs--a systematic review. , 2012, The Journal of small animal practice.

[18]  Yuanjie Zheng,et al.  Breast Cancer Multi-classification from Histopathological Images with Structured Deep Learning Model , 2017, Scientific Reports.

[19]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[20]  Sameer Shrivastava,et al.  Multiplexed Autoantibody Signature for Serological Detection of Canine Mammary Tumours , 2018, Scientific Reports.

[21]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[22]  A. Jemal,et al.  Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries , 2018, CA: a cancer journal for clinicians.

[23]  Nasir M. Rajpoot,et al.  Stain Deconvolution Using Statistical Analysis of Multi-Resolution Stain Colour Representation , 2017, PloS one.

[24]  Peter H. N. de With,et al.  Stain normalization of histopathology images using generative adversarial networks , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[25]  Agneta Egenvall,et al.  Incidence of and survival after mammary tumors in a population of over 80,000 insured female dogs in Sweden from 1995 to 2002. , 2005, Preventive veterinary medicine.

[26]  C. Lee Giles,et al.  Pruning recurrent neural networks for improved generalization performance , 1994, IEEE Trans. Neural Networks.

[27]  Ronald M. Summers,et al.  Deep Learning in Medical Imaging: Overview and Future Promise of an Exciting New Technique , 2016 .

[28]  Luiz Eduardo Soares de Oliveira,et al.  A Dataset for Breast Cancer Histopathological Image Classification , 2016, IEEE Transactions on Biomedical Engineering.

[29]  Kwang In Kim,et al.  On Implicit Filter Level Sparsity in Convolutional Neural Networks , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[31]  Hanan Samet,et al.  Pruning Filters for Efficient ConvNets , 2016, ICLR.

[32]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[33]  Luiz Eduardo Soares de Oliveira,et al.  Breast cancer histopathological image classification using Convolutional Neural Networks , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[34]  J. Elmore,et al.  Diagnostic concordance among pathologists interpreting breast biopsy specimens. , 2015, JAMA.

[35]  G. Folkers,et al.  Swiss Feline Cancer Registry: A Retrospective Study of the Occurrence of Tumours in Cats in Switzerland from 1965 to 2008. , 2015, Journal of comparative pathology.

[36]  Luiz Eduardo Soares de Oliveira,et al.  Deep features for breast cancer histopathological image classification , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[37]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[38]  Harris Drucker,et al.  Comparison of learning algorithms for handwritten digit recognition , 1995 .

[39]  Nasir M. Rajpoot,et al.  A Nonlinear Mapping Approach to Stain Normalization in Digital Histopathology Images Using Image-Specific Color Deconvolution , 2014, IEEE Transactions on Biomedical Engineering.

[40]  Ehsan Kazemi,et al.  Deep Convolutional Neural Networks Enable Discrimination of Heterogeneous Digital Pathology Images , 2017, bioRxiv.

[41]  Bram van Ginneken,et al.  Pulmonary Nodule Detection in CT Images: False Positive Reduction Using Multi-View Convolutional Networks , 2016, IEEE Transactions on Medical Imaging.

[42]  Arnav Bhavsar,et al.  Breast Cancer Histopathological Image Classification: Is Magnification Important? , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[43]  Mariusz Bajger,et al.  Deep learning and color variability in breast cancer histopathological images: a preliminary study , 2018, Other Conferences.

[44]  Sajad Ahmad Wani,et al.  Gene expression profiling of spontaneously occurring canine mammary tumours: Insight into gene networks and pathways linked to cancer pathogenesis , 2018, PloS one.

[45]  Rajesh Mehra,et al.  Automatic Magnification Independent Classification of Breast Cancer Tissue in Histological Images Using Deep Convolutional Neural Network , 2018, Communications in Computer and Information Science.

[46]  Arnav Bhavsar,et al.  Sequential Modeling of Deep Features for Breast Cancer Histopathological Image Classification , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[47]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[48]  J. S. Marron,et al.  A method for normalizing histology slides for quantitative analysis , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[49]  Heng Huang,et al.  Supervised Intra-embedding of Fisher Vectors for Histopathology Image Classification , 2017, MICCAI.