A benchmark bone marrow aspirate smear dataset and a multi-scale cell detection model for the diagnosis of hematological disorders

Research on pathological diagnosis of hematopoietic disorders based on bone marrow aspirate smear images has attracted more and more attention with the development of deep learning methods. However, high quality bone marrow aspirate smear image datasets are not readily available because of the time, the efforts, and the medical knowledge required in the acquisition and manual annotation images. In order to facilitate the research of automated diagnosis of hematological disorders, we constructed a high quality Bone Marrow Aspirate Smear Image Dataset (BMASID), which contains 230 bone marrow aspirate smear images, all with the corresponding labeled images. We used additional clinical images as testing data, which are more challenging because of image noise, cell overlap, cell adhesion, blurred borders of cells and ambiguous types of cells. We also proposed a Cell Recognition Network (CRNet) that was trained on this benchmark dataset. CRNet is comprised of a cell detector to locate and recognize cells in the bone marrow aspirate images, and a cell classifier to classify the types of cells. New anchors and novel evaluation metrics are proposed and applied in CRNet. Benchmark evaluations of the proposed CRNet demonstrated the satisfactory performance of our state-of-the-art methods. Experimental results show that the detection precision by detector is more than 83%, and it is better when compared with other detection methods. After the cell type confirmation by the cell classifier, the precision is more than 95%. Compared with the most popular evaluation metrics Intersection over Union (IoU) and the newly proposed Generalized Intersection over Union (GIoU) used in the object detection benchmarks, our evaluation metrics are more suitable for the cell detection task with ambiguous cell boundaries. The proposed bone marrow aspirate smear image dataset and the proposed evaluation metrics can be used in the training and the evaluation of cell detection models, which contributes to future research in the pathological analysis and auxiliary diagnostic methods of hematological disorders. The codes are available at: https://github.com/SuJie-Med/hematolgical-disorders.

[1]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Yuning Jiang,et al.  Acquisition of Localization Confidence for Accurate Object Detection , 2018, ECCV.

[3]  Nima Tajbakhsh,et al.  UNet++: A Nested U-Net Architecture for Medical Image Segmentation , 2018, DLMIA/ML-CDS@MICCAI.

[4]  Jie Hu,et al.  Abnormal localization of immature precursors (ALIP) detection for early prediction of acute myelocytic leukemia (AML) relapse , 2014, Medical & Biological Engineering & Computing.

[5]  Vincenzo Piuri,et al.  All-IDB: The acute lymphoblastic leukemia image database for image processing , 2011, 2011 18th IEEE International Conference on Image Processing.

[6]  Zhou Dongxiang,et al.  Segmentation of Color Overlapping Cells Image Based on Sparse Contour Point Model , 2015 .

[7]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[8]  Di Wang,et al.  Deep learning approach to peripheral leukocyte recognition , 2019, PloS one.

[9]  Hanadi El Achi,et al.  Artificial Intelligence and Digital Microscopy Applications in Diagnostic Hematopathology , 2020, Cancers.

[10]  Yang Wang,et al.  Optimizing Intersection-Over-Union in Deep Neural Networks for Image Segmentation , 2016, ISVC.

[11]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[13]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[14]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[15]  David A. McAllester,et al.  A discriminatively trained, multiscale, deformable part model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Yan Li,et al.  Segmentation of White Blood Cell from Acute Lymphoblastic Leukemia Images Using Dual-Threshold Method , 2016, Comput. Math. Methods Medicine.

[17]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  D. Goutam,et al.  Classification of acute myelogenous leukemia in blood microscopic images using supervised classifier , 2015, 2015 IEEE International Conference on Engineering and Technology (ICETECH).

[19]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Nasir M. Rajpoot,et al.  Simultaneous Cell Detection and Classification in Bone Marrow Histology Images , 2019, IEEE Journal of Biomedical and Health Informatics.

[21]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Silvio Savarese,et al.  Generalized Intersection Over Union: A Metric and a Loss for Bounding Box Regression , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[24]  Shuai Liu,et al.  A segmentation method based on HMRF for the aided diagnosis of acute myeloid leukemia , 2017, Comput. Methods Programs Biomed..