Deep learning approach to peripheral leukocyte recognition

Microscopic examination of peripheral blood plays an important role in the field of diagnosis and control of major diseases. Peripheral leukocyte recognition by manual requires medical technicians to observe blood smears through light microscopy, using their experience and expertise to discriminate and analyze different cells, which is time-consuming, labor-intensive and subjective. The traditional systems based on feature engineering often need to ensure successful segmentation and then manually extract certain quantitative and qualitative features for recognition but still remaining a limitation of poor robustness. The classification pipeline based on convolutional neural network is of automatic feature extraction and free of segmentation but hard to deal with multiple object recognition. In this paper, we take leukocyte recognition as object detection task and apply two remarkable object detection approaches, Single Shot Multibox Detector and An Incremental Improvement Version of You Only Look Once. To improve recognition performance, some key factors involving these object detection approaches are explored and the detection models are generated using the train set of 14,700 annotated images. Finally, we evaluate these detection models on test sets consisting of 1,120 annotated images and 7,868 labeled single object images corresponding to 11 categories of peripheral leukocytes, respectively. A best mean average precision of 93.10% and mean accuracy of 90.09% are achieved while the inference time is 53 ms per image on a NVIDIA GTX1080Ti GPU.

[1]  Mu-Chun Su,et al.  A Neural-Network-Based Approach to White Blood Cell Classification , 2014, TheScientificWorldJournal.

[2]  J Rodellar,et al.  Characterization and automatic screening of reactive and abnormal neoplastic B lymphoid cells from peripheral blood , 2016, International journal of laboratory hematology.

[3]  Min Zhang,et al.  White Blood Cells Classification with Deep Convolutional Neural Networks , 2018, Int. J. Pattern Recognit. Artif. Intell..

[4]  Yanhui Guo,et al.  White blood cells identification system based on convolutional deep neural learning networks , 2017, Comput. Methods Programs Biomed..

[5]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Anand S. Dighe,et al.  A novel strategy for evaluating the effects of an electronic test ordering alert message: Optimizing cardiac marker use , 2012, Journal of pathology informatics.

[7]  Saeed Kermani,et al.  Computer aided detection and classification of acute lymphoblastic leukemia cell subtypes based on microscopic image analysis , 2016, Microscopy research and technique.

[8]  B. Bain,et al.  Diagnosis from the blood smear. , 2005, The New England journal of medicine.

[9]  Thomas J. S. Durant,et al.  Very Deep Convolutional Neural Networks for Morphologic Classification of Erythrocytes. , 2017, Clinical chemistry.

[10]  Jieping Ye,et al.  Object Detection in 20 Years: A Survey , 2019, Proceedings of the IEEE.

[11]  Rui Kang,et al.  An End-to-End System for Automatic Urinary Particle Recognition with Convolutional Neural Network , 2018, Journal of Medical Systems.

[12]  Shuying Shen,et al.  Fine-grained leukocyte classification with deep residual learning for microscopic images , 2018, Comput. Methods Programs Biomed..

[13]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[14]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[15]  Santiago Alférez,et al.  Automatic recognition of atypical lymphoid cells from peripheral blood by digital image analysis. , 2015, American journal of clinical pathology.

[16]  Cecilia Di Ruberto,et al.  Leucocyte classification for leukaemia detection using image processing techniques , 2014, Artif. Intell. Medicine.

[17]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Yi Li,et al.  R-FCN: Object Detection via Region-based Fully Convolutional Networks , 2016, NIPS.

[20]  Tamalika Chaira,et al.  Accurate segmentation of leukocyte in blood cell images using Atanassov's intuitionistic fuzzy and interval Type II fuzzy set theory. , 2014, Micron.

[21]  Osman Kalender,et al.  Automatic segmentation, counting, size determination and classification of white blood cells , 2014 .

[22]  Lixin Zheng,et al.  Combining Convolutional Neural Network With Recursive Neural Network for Blood Cell Image Classification , 2018, IEEE Access.

[23]  J. Ford,et al.  Red blood cell morphology , 2013, International journal of laboratory hematology.

[24]  Manohar Kuse,et al.  Scalable system for classification of white blood cells from Leishman stained blood stain images , 2013, Journal of pathology informatics.

[25]  Zahid Mehmood,et al.  Classification of acute lymphoblastic leukemia using deep learning , 2018, Microscopy research and technique.

[26]  Jaroonrut Prinyakupt,et al.  Segmentation of white blood cells and comparison of cell morphology by linear and naïve Bayes classifiers , 2015, BioMedical Engineering OnLine.

[27]  Chih-Han Chang,et al.  Biomechanical evaluation of a novel wheelchair backrest for elderly people , 2015, Biomedical engineering online.

[28]  Filiberto Pla,et al.  Recognizing white blood cells with local image descriptors , 2019, Expert Syst. Appl..

[29]  A. Saraya,et al.  Red cell membrane disorders. , 1994, The Journal of the Association of Physicians of India.

[30]  Dumitru Erhan,et al.  Scalable Object Detection Using Deep Neural Networks , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Jianwei Zhao,et al.  Automatic detection and classification of leukocytes using convolutional neural networks , 2016, Medical & Biological Engineering & Computing.

[32]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[33]  Xiang Zhang,et al.  OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks , 2013, ICLR.

[34]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  H. Ceelie,et al.  Examination of peripheral blood films using automated microscopy; evaluation of Diffmaster Octavia and Cellavision DM96 , 2006, Journal of Clinical Pathology.

[36]  Hamid Soltanian-Zadeh,et al.  Automatic Recognition of Five Types of White Blood Cells in Peripheral Blood , 2010, ICIAR.

[37]  Kurt Konolige,et al.  CenSurE: Center Surround Extremas for Realtime Feature Detection and Matching , 2008, ECCV.

[38]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[39]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[40]  David Morrow,et al.  Cardiovascular Disease: Impact of Biomarkers, Proteomics, and Genomics. , 2017, Clinical chemistry.

[41]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[42]  Matti Pietikäinen,et al.  Deep Learning for Generic Object Detection: A Survey , 2018, International Journal of Computer Vision.

[43]  Jin Woo Choi,et al.  White blood cell differential count of maturation stages in bone marrow smear using dual-stage convolutional neural networks , 2017, PloS one.

[44]  Joel J. P. C. Rodrigues,et al.  Detection of subtype blood cells using deep learning , 2018, Cognitive Systems Research.

[45]  Sos S. Agaian,et al.  Automated Screening System for Acute Myelogenous Leukemia Detection in Blood Microscopic Images , 2014, IEEE Systems Journal.

[46]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[47]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[48]  Dumitru Erhan,et al.  Deep Neural Networks for Object Detection , 2013, NIPS.

[49]  Tolga Tasdizen,et al.  Isolation and two-step classification of normal white blood cells in peripheral blood smears , 2012, Journal of pathology informatics.

[50]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.