An Automatic Nucleus Segmentation and CNN Model based Classification Method of White Blood Cell

Abstract White blood cells (WBCs) play a remarkable role in the human immune system. To diagnose blood-related diseases, pathologists need to consider the characteristics of WBC. The characteristics of WBC can be defined based on the morphological properties of WBC nucleus. Therefore, nucleus segmentation plays a vital role to classify the WBC image and it is an important part of the medical diagnosis system. In this study, color space conversion and k-means algorithm based new WBC nucleus segmentation method is proposed. Then we localize the WBC based on the location of segmented nucleus to separate them from the entire blood smear image. To classify the localized WBC image, we propose a new convolutional neural network (CNN) model by combining the concept of fusing the features of first and last convolutional layers, and propagating the input image to the convolutional layer. We also use a dropout layer for preventing the model from overfitting problem. We show the effectiveness of our proposed nucleus segmentation method by evaluating with seven quality metrics and comparing with other methods on four public databases. We achieve average accuracy of 98.61% and more than 97% on each public database. We also evaluate our proposed CNN model by using nine classification metrics and achieve an overall accuracy of 96% on BCCD test database. To validate the generalization capability of our proposed CNN model, we show the training and testing accuracy and loss curves for random test set of BCCD database. Further, we compare the performance of our proposed CNN model with four state-of-the-art CNN models (biomedical image classifier) by measuring the value of evaluation metrics.

[1]  Flávio H. D. Araújo,et al.  Unsupervised Leukemia Cells Segmentation Based on Multi-space Color Channels , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[2]  Xin Zheng,et al.  Fast and robust segmentation of white blood cell images by self-supervised learning. , 2018, Micron.

[3]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[5]  Saeed Kermani,et al.  Recognition of Acute Lymphoblastic Leukemia Cells in Microscopic Images Using K-Means Clustering and Support Vector Machine Classifier , 2015, Journal of medical signals and sensors.

[6]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  G. Zack,et al.  Automatic measurement of sister chromatid exchange frequency. , 1977, The journal of histochemistry and cytochemistry : official journal of the Histochemistry Society.

[8]  Luciano da Fontoura Costa,et al.  A texture approach to leukocyte recognition , 2004, Real Time Imaging.

[9]  Ratko Grbić,et al.  Automatic White Blood Cell Detection and Identification Using Convolutional Neural Network , 2018, 2018 International Conference on Smart Systems and Technologies (SST).

[10]  Mu-Chun Su,et al.  A Neural-Network-Based Approach to White Blood Cell Classification , 2014, TheScientificWorldJournal.

[11]  Cheng Yang,et al.  Automatic classification of leukocytes using deep neural network , 2017, 2017 IEEE 12th International Conference on ASIC (ASICON).

[12]  Jennifer C. Dela Cruz,et al.  White blood cell classification and counting using convolutional neural network , 2018, 2018 3rd International Conference on Control and Robotics Engineering (ICCRE).

[13]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Salim Arslan,et al.  A color and shape based algorithm for segmentation of white blood cells in peripheral blood and bone marrow images , 2014, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[15]  Shuying Shen,et al.  Fine-grained leukocyte classification with deep residual learning for microscopic images , 2018, Comput. Methods Programs Biomed..

[16]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[17]  Vincenzo Piuri,et al.  All-IDB: The acute lymphoblastic leukemia image database for image processing , 2011, 2011 18th IEEE International Conference on Image Processing.

[18]  Joel J. P. C. Rodrigues,et al.  Detection of subtype blood cells using deep learning , 2018, Cognitive Systems Research.

[19]  Ki-Ryong Kwon,et al.  Acute lymphoid leukemia classification using two-step neural network classifier , 2015, 2015 21st Korea-Japan Joint Workshop on Frontiers of Computer Vision (FCV).

[20]  Mehmet A. Orgun,et al.  A novel fused convolutional neural network for biomedical image classification , 2018, Medical & Biological Engineering & Computing.

[21]  David L. Olson,et al.  Performance Evaluation for Predictive Modeling , 2008 .

[22]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Osman Kalender,et al.  Automatic segmentation, counting, size determination and classification of white blood cells , 2014 .

[24]  Lixin Zheng,et al.  Combining Convolutional Neural Network With Recursive Neural Network for Blood Cell Image Classification , 2018, IEEE Access.

[25]  Behrouz Homayoun Far,et al.  An efficient technique for white blood cells nuclei automatic segmentation , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[26]  Mei Zhou,et al.  A spectral and morphologic method for white blood cell classification , 2016 .

[27]  Hamid Soltanian-Zadeh,et al.  Automatic Recognition of Five Types of White Blood Cells in Peripheral Blood , 2010, ICIAR.

[28]  Hinrich Schütze,et al.  Book Reviews: Foundations of Statistical Natural Language Processing , 1999, CL.

[29]  Romuere Rôdrigues Veloso e Silva,et al.  Recent computational methods for white blood cell nuclei segmentation: A comparative study , 2019, Comput. Methods Programs Biomed..

[30]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  M.Y. Mashor,et al.  Unsupervised colour segmentation of white blood cell for acute leukaemia images , 2011, 2011 IEEE International Conference on Imaging Systems and Techniques.

[32]  I. Young,et al.  The classification of white blood cells. , 1972, IEEE transactions on bio-medical engineering.

[33]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[34]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[35]  Mohamed Elhoseny,et al.  Computer-Aided Acute Lymphoblastic Leukemia Diagnosis System Based on Image Analysis , 2018 .

[36]  Dipti Patra,et al.  Fuzzy Based Blood Image Segmentation for Automated Leukemia Detection , 2011, 2011 International Conference on Devices and Communications (ICDeCom).

[37]  Jaroonrut Prinyakupt,et al.  Segmentation of white blood cells and comparison of cell morphology by linear and naïve Bayes classifiers , 2015, BioMedical Engineering OnLine.

[38]  Ali Razavi,et al.  Recognition and Counting of WBCs using Wavelet Transform , 2012 .

[39]  Hossein Rabbani,et al.  A simple and accurate method for white blood cells segmentation using K-means algorithm , 2015, 2015 IEEE Workshop on Signal Processing Systems (SiPS).

[40]  Partha Pratim Banik,et al.  Fused Convolutional Neural Network for White Blood Cell Image Classification , 2019, 2019 International Conference on Artificial Intelligence in Information and Communication (ICAIIC).

[41]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[42]  Vijay V. Raghavan,et al.  A critical investigation of recall and precision as measures of retrieval system performance , 1989, TOIS.