Machine-Based Detection and Classification for Bone Marrow Aspirate Differential Counts: Initial Development Focusing on Non-Neoplastic Cells

Bone marrow aspirate (BMA) differential cell counts (DCCs) are critical for the classification of hematologic disorders. While manual counts are considered the gold standard, they are labor intensive, time consuming, and subject to bias. A reliable automated counter has yet to be developed, largely due to the inherent complexity of bone marrow specimens. Digital pathology imaging coupled with machine learning algorithms represents a highly promising emerging technology for this purpose. Yet, training datasets for BMA cellular constituents, critical for building and validating machine learning algorithms, are lacking. Herein, we report our experience creating and employing such datasets to develop a machine learning algorithm to detect and classify BMA cells. Utilizing a web-based system that we developed for annotating and managing digital pathology images, over 10,000 cells from scanned whole slide images of BMA smears were manually annotated, including all classes that comprise the standard clinical DCC. We implemented a two-stage, detection and classification approach that allows design flexibility and improved classification accuracy. In a sixfold cross-validation, our algorithms achieved high overall accuracy in detection (0.959 ± 0.008 precision-recall AUC) and classification (0.982 ± 0.03 ROC AUC) using nonneoplastic samples. Testing on a small set of acute myeloid leukemia and multiple myeloma samples demonstrated similar detection and classification performance. In summary, our algorithms showed promising early results and represent an important initial step in the effort to devise a reliable, objective method to automate DCCs. With further development to include formal clinical validation, such a system has the potential to assist in disease diagnosis and prognosis, and significantly impact clinical practice. Bone marrow aspirate (BMA) differential cell counts (DCCs) are critical for classification of hematologic disorders. Manual DCCs are still considered the gold standard as a reliable automated method is yet to be developed. Digital pathology and machine learning represent a highly promising technology for this purpose. The authors report their experience developing machine learning algorithms to detect and classify BMA cells. Promising early results signify an important initial step in the effort to devise a reliable, objective method to automate DCCs.

[1]  Sanghoon Lee,et al.  The Digital Slide Archive: A Software Platform for Management, Integration, and Analysis of Histology for Cancer Research. , 2017, Cancer research.

[2]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[3]  Andrew Janowczyk,et al.  Deep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases , 2016, Journal of pathology informatics.

[4]  C Briggs,et al.  Can automated blood film analysis replace the manual differential? An evaluation of the CellaVision DM96 automated image analysis system , 2009, International journal of laboratory hematology.

[5]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[6]  Jesus A. Gonzalez,et al.  Segmentation and Classification of Bone Marrow Cells Images Using Contextual Information for Medical Diagnosis of Acute Leukemias , 2015, PloS one.

[7]  Thomas J. Fuchs,et al.  Clinical-grade computational pathology using weakly supervised deep learning on whole slide images , 2019, Nature Medicine.

[8]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Mark Goadrich,et al.  The relationship between Precision-Recall and ROC curves , 2006, ICML.

[10]  Nasir M. Rajpoot,et al.  Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images , 2016, IEEE Trans. Medical Imaging.

[11]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Jin Woo Choi,et al.  White blood cell differential count of maturation stages in bone marrow smear using dual-stage convolutional neural networks , 2017, PloS one.

[13]  B. Bain,et al.  Dacie and Lewis Practical Haematology , 2006 .

[14]  D. Jaye,et al.  Is a 500-Cell Count Necessary for Bone Marrow Differentials?: A Proposed Analytical Method for Validating a Lower Cutoff , 2018, American journal of clinical pathology.

[15]  S. Swerdlow WHO Classification of Tumours of Haematopoietic and Lymphoid Tissues , 2017 .

[16]  Dmitrii Bychkov,et al.  Deep learning based tissue analysis predicts outcome in colorectal cancer , 2018, Scientific Reports.

[17]  Robin T Vollmer Blast counts in bone marrow aspirate smears: analysis using the poisson probability function, bayes theorem, and information theory. , 2009, American journal of clinical pathology.

[18]  Rajarsi R. Gupta,et al.  Spatial Organization and Molecular Correlation of Tumor-Infiltrating Lymphocytes Using Deep Learning on Pathology Images. , 2018, Cell reports.

[19]  Yukio Hamaguchi,et al.  Automation of bone marrow aspirate examination using the XE‐2100 automated hematology analyzer , 2004, Cytometry. Part B, Clinical cytometry.

[20]  Michele D. Raible,et al.  Color Atlas of Hematology: An Illustrated Field Guide Based on Proficiency Testing , 2009 .

[21]  Gina Zini,et al.  Analysis of bone marrow aspiration fluid using automated blood cell counters. , 2015, Clinics in laboratory medicine.

[22]  A. Porwit,et al.  ICSH guidelines for the standardization of bone marrow specimens and reports , 2008, International journal of laboratory hematology.

[23]  Kent B Lewandrowski,et al.  Performance evaluation of the CellaVision DM96 system: WBC differentials by automated digital image analysis supported by an artificial neural network. , 2005, American journal of clinical pathology.

[24]  Gerard Lozanski,et al.  DeepFocus: Detection of out-of-focus regions in whole slide digital images using deep learning , 2018, PloS one.

[25]  Guy Lapalme,et al.  A systematic analysis of performance measures for classification tasks , 2009, Inf. Process. Manag..

[26]  D. Brat,et al.  Predicting cancer outcomes from histology and genomics using convolutional networks , 2017, Proceedings of the National Academy of Sciences.

[27]  X. Troussard,et al.  Performance evaluation and relevance of the CellaVision™ DM96 system in routine analysis and in patients with malignant hematological diseases , 2007, International journal of laboratory hematology.