White blood cells identification system based on convolutional deep neural learning networks

BACKGROUND AND OBJECTIVES White blood cells (WBCs) differential counting yields valued information about human health and disease. The current developed automated cell morphology equipments perform differential count which is based on blood smear image analysis. Previous identification systems for WBCs consist of successive dependent stages; pre-processing, segmentation, feature extraction, feature selection, and classification. There is a real need to employ deep learning methodologies so that the performance of previous WBCs identification systems can be increased. Classifying small limited datasets through deep learning systems is a major challenge and should be investigated. METHODS In this paper, we propose a novel identification system for WBCs based on deep convolutional neural networks. Two methodologies based on transfer learning are followed: transfer learning based on deep activation features and fine-tuning of existed deep networks. Deep acrivation featues are extracted from several pre-trained networks and employed in a traditional identification system. Moreover, a novel end-to-end convolutional deep architecture called "WBCsNet" is proposed and built from scratch. Finally, a limited balanced WBCs dataset classification is performed through the WBCsNet as a pre-trained network. RESULTS During our experiments, three different public WBCs datasets (2551 images) have been used which contain 5 healthy WBCs types. The overall system accuracy achieved by the proposed WBCsNet is (96.1%) which is more than different transfer learning approaches or even the previous traditional identification system. We also present features visualization for the WBCsNet activation which reflects higher response than the pre-trained activated one. CONCLUSION a novel WBCs identification system based on deep learning theory is proposed and a high performance WBCsNet can be employed as a pre-trained network.

[1]  Simone Palazzo,et al.  Deep learning for automated skeletal bone age assessment in X‐ray images , 2017, Medical Image Anal..

[2]  Vincenzo Piuri,et al.  All-IDB: The acute lymphoblastic leukemia image database for image processing , 2011, 2011 18th IEEE International Conference on Image Processing.

[3]  Xiang Zhang,et al.  OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks , 2013, ICLR.

[4]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[5]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[6]  Mei Zhou,et al.  A spectral and morphologic method for white blood cell classification , 2016 .

[7]  Hamid Soltanian-Zadeh,et al.  Automatic Recognition of Five Types of White Blood Cells in Peripheral Blood , 2010, ICIAR.

[8]  Wei Li,et al.  A fused deep learning architecture for viewpoint classification of echocardiography , 2017, Inf. Fusion.

[9]  Mehmet A. Orgun,et al.  A novel end-to-end classifier using domain transferred deep convolutional neural networks for biomedical images , 2017, Comput. Methods Programs Biomed..

[10]  Tolga Tasdizen,et al.  Isolation and two-step classification of normal white blood cells in peripheral blood smears , 2012, Journal of pathology informatics.

[11]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Qi Zhang,et al.  Deep learning based classification of breast tumors with shear-wave elastography. , 2016, Ultrasonics.

[13]  Mita Nasipuri,et al.  Blood smear analyzer for white blood cell counting: A hybrid microscopic image analyzing technique , 2016, Appl. Soft Comput..

[14]  Thomas J. Kipps,et al.  Williams manual of hematology , 2011 .

[15]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[16]  Trevor Darrell,et al.  DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition , 2013, ICML.

[17]  M. P. van den Heuvel,et al.  Deep learning predictions of survival based on MRI in amyotrophic lateral sclerosis , 2016, NeuroImage: Clinical.

[18]  Anand S. Dighe,et al.  A novel strategy for evaluating the effects of an electronic test ordering alert message: Optimizing cardiac marker use , 2012, Journal of pathology informatics.

[19]  Cecilia Di Ruberto,et al.  Leucocyte classification for leukaemia detection using image processing techniques , 2014, Artif. Intell. Medicine.

[20]  Tieniu Tan,et al.  DeepIris: Learning pairwise filter bank for heterogeneous iris verification , 2016, Pattern Recognit. Lett..

[21]  Anja Leyte,et al.  Clinical performance evaluation of the CellaVision Image Capture System in the white blood cell differential on peripheral blood smears , 2013, Journal of Clinical Pathology.

[22]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[23]  Nico Karssemeijer,et al.  Large scale deep learning for computer aided detection of mammographic lesions , 2017, Medical Image Anal..

[24]  Yuan Zhou,et al.  A novel color image segmentation method and its application to white blood cell image analysis , 2006, 2006 8th international Conference on Signal Processing.

[25]  Gui-Song Xia,et al.  Transferring Deep Convolutional Neural Networks for the Scene Classification of High-Resolution Remote Sensing Imagery , 2015, Remote. Sens..

[26]  Xiaohong W. Gao,et al.  Classification of CT brain images based on deep learning networks , 2017, Comput. Methods Programs Biomed..

[27]  Jaroonrut Prinyakupt,et al.  Segmentation of white blood cells and comparison of cell morphology by linear and naïve Bayes classifiers , 2015, BioMedical Engineering OnLine.

[28]  Lina J. Karam,et al.  Understanding how image quality affects deep neural networks , 2016, 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX).

[29]  Osman Kalender,et al.  Automatic segmentation, counting, size determination and classification of white blood cells , 2014 .

[30]  Ali Razavi,et al.  Recognition and Counting of WBCs using Wavelet Transform , 2012 .

[31]  Khalid M. Amin,et al.  A novel breast tumor classification algorithm using neutrosophic score features , 2016 .

[32]  Derek Hoiem,et al.  Diagnosing Error in Object Detectors , 2012, ECCV.

[33]  Manohar Kuse,et al.  Scalable system for classification of white blood cells from Leishman stained blood stain images , 2013, Journal of pathology informatics.

[34]  Brian Toone,et al.  Activation associated with incentives in a rewarded CPT task using fMRI , 2001, NeuroImage.

[35]  Xiaogang Wang,et al.  DeepID3: Face Recognition with Very Deep Neural Networks , 2015, ArXiv.

[36]  Luis Miguel Bergasa,et al.  Fusion and binarization of CNN features for robust topological localization across seasons , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[37]  Stefan Carlsson,et al.  CNN Features Off-the-Shelf: An Astounding Baseline for Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[38]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[39]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Mu-Chun Su,et al.  A Neural-Network-Based Approach to White Blood Cell Classification , 2014, TheScientificWorldJournal.