HWDCNN: Multi-class recognition in breast histopathology with Haar wavelet decomposed image based convolution neural network

Abstract Among the predominant cancers, breast cancer is one of the main causes of cancer deaths impacting women worldwide. However, breast cancer classification is challenging due to numerous morphological and textural variations that appeared in intra-class images. Also, the direct processing of high resolution histological images is uneconomical in terms of GPU memory. In the present study, we have proposed a new approach for breast histopathological image classification that uses a deep convolution neural network (CNN) with wavelet decomposed images. The original microscopic image patches of 2048 × 1536 × 3 pixels are decomposed into 512 × 384 × 3 using 2-level Haar wavelet and subsequently used in proposed CNN model. The image decomposition step considerably reduces convolution time in deep CNNs and computational resources, without any performance downgrade. The CNN model extracts the deep features from Haar wavelet decomposed images and incorporates multi-scale discriminant features for precise prognostication of class labels. This paper also solves the demand for massive histopathology dataset by means of transfer learning and data augmentation techniques. The efficacy of proposed approach is corroborated on two publicly available breast histology datasets-(a) one provided as a part of international conference on image analysis and recognition (ICIAR 2018) grand challenge and (b) on BreakHis data. On the ICIAR 2018 validation data, our model showed an accuracy of 98.2% for both 4-class and 2-class recognition. Further, on hidden test data of the ICIAR 2018, we achieved an accuracy of 91%, outperforming existing state-of-the-art results significantly. Besides, on BreakHis dataset, the model achieved competing performance with 96.85% multi-class accuracy.

[1]  Cuong Nguyen,et al.  Random forest classifier combined with feature selection for breast cancer diagnosis and prognostic , 2013 .

[2]  Shaoqun Zeng,et al.  From Detection of Individual Metastases to Classification of Lymph Node Status at the Patient Level: The CAMELYON17 Challenge , 2019, IEEE Transactions on Medical Imaging.

[3]  Daisuke Komura,et al.  Machine Learning Methods for Histopathological Image Analysis , 2017, Computational and structural biotechnology journal.

[4]  Kevin Smith,et al.  Digital image analysis in breast pathology-from image processing techniques to artificial intelligence. , 2017, Translational research : the journal of laboratory and clinical medicine.

[5]  Luca Maria Gambardella,et al.  Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence Flexible, High Performance Convolutional Neural Networks for Image Classification , 2022 .

[6]  Luiz Eduardo Soares de Oliveira,et al.  Breast cancer histopathological image classification using Convolutional Neural Networks , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[7]  Chandan Chakraborty,et al.  Efficient deep learning model for mitosis detection using breast histopathology images , 2017, Comput. Medical Imaging Graph..

[8]  Mita Nasipuri,et al.  Patch-based system for Classification of Breast Histology images using deep learning , 2019, Comput. Medical Imaging Graph..

[9]  Nico Karssemeijer,et al.  Stain Specific Standardization of Whole-Slide Histopathological Images , 2016, IEEE Transactions on Medical Imaging.

[10]  Nasir M. Rajpoot,et al.  A gamma-gaussian mixture model for detection of mitotic cells in breast cancer histopathology images , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[11]  Jong Chul Ye,et al.  A deep convolutional neural network using directional wavelets for low‐dose X‐ray CT reconstruction , 2016, Medical physics.

[12]  Ingrid Daubechies,et al.  The wavelet transform, time-frequency localization and signal analysis , 1990, IEEE Trans. Inf. Theory.

[13]  Kamyar Nazeri,et al.  Two-Stage Convolutional Neural Network for Breast Cancer Histology Image Classification , 2018 .

[14]  Örjan Smedby,et al.  Breast Cancer Histological Image Classification Using Fine-Tuned Deep Network Fusion , 2018, ICIAR.

[15]  A. Jemal,et al.  Cancer statistics, 2019 , 2019, CA: a cancer journal for clinicians.

[16]  William H. Hsu,et al.  Genetic wrappers for feature selection in decision tree induction and variable ordering in Bayesian network structure learning , 2004, Inf. Sci..

[17]  Varun Srivastava,et al.  Cancerous Cell Detection UsingHistopathological Image Analysis , 2015 .

[18]  A. Jemal,et al.  Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries , 2018, CA: a cancer journal for clinicians.

[19]  Fuchun Sun,et al.  HyperNet: Towards Accurate Region Proposal Generation and Joint Object Detection , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  H. Irshad,et al.  Methods for Nuclei Detection, Segmentation, and Classification in Digital Histopathology: A Review—Current Status and Future Potential , 2014, IEEE Reviews in Biomedical Engineering.

[22]  Boqian Wu,et al.  Multi-Scale Deep Neural Network for Mitosis Detection in Histological Images , 2018, 2018 International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS).

[23]  Hanqiang Cao,et al.  Nearest Neighbor Value Interpolation , 2012, ArXiv.

[24]  Lipo Wang,et al.  Deep Learning Applications in Medical Image Analysis , 2018, IEEE Access.

[25]  Wenyu Liu,et al.  Revisiting multiple instance neural networks , 2016, Pattern Recognit..

[26]  Hayet Farida Merouani,et al.  Wavelet based feature extraction method for breast cancer diagnosis , 2018, 2018 4th International Conference on Advanced Technologies for Signal and Image Processing (ATSIP).

[27]  Luiz Eduardo Soares de Oliveira,et al.  A Dataset for Breast Cancer Histopathological Image Classification , 2016, IEEE Transactions on Biomedical Engineering.

[28]  Alexander Rakhlin,et al.  Deep Convolutional Neural Networks for Breast Cancer Histology Image Analysis , 2018, bioRxiv.

[29]  Sang Won Yoon,et al.  A support vector machine-based ensemble algorithm for breast cancer diagnosis , 2017, Eur. J. Oper. Res..

[30]  Taysir Hassan A. Soliman,et al.  Multi-Class Breast Cancer Classification using Deep Learning Convolutional Neural Network , 2018 .

[31]  David Gur,et al.  Improving breast mass detection using histogram of oriented gradients , 2014, Medical Imaging.

[32]  Muhammad Imran Razzak,et al.  Deep Learning for Medical Image Processing: Overview, Challenges and Future , 2017, ArXiv.

[33]  Arnav Bhavsar,et al.  Breast Cancer Histopathological Image Classification: Is Magnification Important? , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[34]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[35]  A. Ruifrok,et al.  Quantification of histochemical staining by color deconvolution. , 2001, Analytical and quantitative cytology and histology.

[36]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[37]  Erik Reinhard,et al.  Color Transfer between Images , 2001, IEEE Computer Graphics and Applications.

[38]  Anant Madabhushi,et al.  Accurate and reproducible invasive breast cancer detection in whole-slide images: A Deep Learning approach for quantifying tumor extent , 2017, Scientific Reports.

[39]  J. S. Marron,et al.  A method for normalizing histology slides for quantitative analysis , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[40]  Pierre Baldi,et al.  Deep Learning for Drug Discovery and Cancer Research: Automated Analysis of Vascularization Images , 2019, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[41]  John Meyer,et al.  Grading nuclear pleomorphism on histological micrographs , 2008, 2008 19th International Conference on Pattern Recognition.

[42]  Daniel Riccio,et al.  Multi-classification of Breast Cancer Histology Images by Using a Fine-Tuning Strategy , 2018, ICIAR.

[43]  Lingling Sun,et al.  Breast Cancer Microscope Image Classification Based on CNN with Image Deformation , 2018, ICIAR.

[44]  Narasimhan P. Agaram,et al.  Atypical ductal hyperplasia: interobserver and intraobserver variability , 2011, Modern Pathology.

[45]  I. Ellis,et al.  Pathological prognostic factors in breast cancer. I. The value of histological grade in breast cancer: experience from a large study with long-term follow-up. , 2002, Histopathology.

[46]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[47]  Xu Liu,et al.  Wavelet-based statistical features for distinguishing mitotic and non-mitotic cells in breast cancer histopathology , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[48]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[49]  Vijayan K. Asari,et al.  Breast Cancer Classification from Histopathological Images with Inception Recurrent Residual Convolutional Neural Network , 2018, Journal of Digital Imaging.

[50]  Aleksey Boyko,et al.  Detecting Cancer Metastases on Gigapixel Pathology Images , 2017, ArXiv.

[51]  Scotty Kwok,et al.  Multiclass Classification of Breast Cancer in Whole-Slide Images , 2018, ICIAR.

[52]  H. Chan,et al.  Advances in computer-aided diagnosis for breast cancer , 2006, Current opinion in obstetrics & gynecology.

[53]  K. Sujathan,et al.  Analysis of nuclei textures of fine needle aspirated cytology images for breast cancer diagnosis using Complex Daubechies wavelets , 2013, Signal Process..

[54]  Luca Maria Gambardella,et al.  A comparison of algorithms and humans for mitosis detection , 2014, 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI).

[55]  Catarina Eloy,et al.  Classification of breast cancer histology images using Convolutional Neural Networks , 2017, PloS one.

[56]  Jian Sun,et al.  Convolutional neural networks at constrained time cost , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[57]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[58]  Alex Varghese,et al.  Classification of Breast Cancer Histology Image using Ensemble of Pre-trained Neural Networks , 2018, ICIAR.

[59]  Constantinos G. Loukas,et al.  Breast Cancer Characterization Based on Image Classification of Tissue Sections Visualized under Low Magnification , 2013, Comput. Math. Methods Medicine.

[60]  Donald L Weaver,et al.  Histological features associated with diagnostic agreement in atypical ductal hyperplasia of the breast: illustrative cases from the B‐Path study , 2016, Histopathology.

[61]  Robert Sabourin,et al.  Improve the performance of transfer learning without fine-tuning using dissimilarity-based multi-view learning for breast cancer histology images , 2018, ICIAR.

[62]  Patrice Y. Simard,et al.  Best practices for convolutional neural networks applied to visual document analysis , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[63]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[64]  Yuanjie Zheng,et al.  Breast Cancer Multi-classification from Histopathological Images with Structured Deep Learning Model , 2017, Scientific Reports.

[65]  T Roberts,et al.  Wavelet-based scaling indices for breast cancer diagnostics. , 2017, Statistics in medicine.

[66]  Catarina Eloy,et al.  BACH: Grand Challenge on Breast Cancer Histology Images , 2018, Medical Image Anal..