Classification of Human White Blood Cells Using Machine Learning for Stain‐Free Imaging Flow Cytometry

Imaging flow cytometry (IFC) produces up to 12 spectrally distinct, information‐rich images of single cells at a throughput of 5,000 cells per second. Yet often, cell populations are still studied using manual gating, a technique that has several drawbacks, hence it would be advantageous to replace manual gating with an automated process. Ideally, this automated process would be based on stain‐free measurements, as the currently used staining techniques are expensive and potentially confounding. These stain‐free measurements originate from the brightfield and darkfield image channels, which capture transmitted and scattered light, respectively. To realize this automated, stain‐free approach, advanced machine learning (ML) methods are required. Previous works have successfully tested this approach on cell cycle phase classification with both a classical ML approach based on manually engineered features, and a deep learning (DL) approach. In this work, we compare both approaches extensively on the problem of white blood cell classification. Four human whole blood samples were assayed on an ImageStream‐X MK II imaging flow cytometer. Two samples were stained for the identification of eight white blood cell types, while two other sample sets were stained for the identification of resting and active eosinophils. For both data sets, four ML classifiers were evaluated on stain‐free imagery with stratified 5‐fold cross‐validation. On the white blood cell data set, the best obtained results were 0.778 and 0.703 balanced accuracy for classical ML and DL, respectively. On the eosinophil data set, this was 0.871 and 0.856 balanced accuracy. We conclude that classifying cell types based on only stain‐free images is possible with all four classifiers. Noteworthy, we also find that the DL approaches tested in this work do not outperform the approaches based on manually engineered features. © 2019 International Society for Advancement of Cytometry

[1]  Leland McInnes,et al.  UMAP: Uniform Manifold Approximation and Projection , 2018, J. Open Source Softw..

[2]  Habib Safigholi,et al.  Dermatologist Level Dermoscopy Skin Cancer Classification Using Different Deep Learning Convolutional Neural Networks Algorithms , 2018, ArXiv.

[3]  A. Kay,et al.  The relationship between infiltrating CD4+ lymphocytes, activated eosinophils, and the magnitude of the allergen-induced late phase cutaneous reaction in man. , 1988, Journal of immunology.

[4]  G. Sachse,et al.  S-phase cell detection with a monoclonal antibody. , 1987, Developments in biological standardization.

[5]  Hayden Kwok-Hay So,et al.  Large-Scale Multi-Class Image-Based Cell Classification With Deep Learning , 2019, IEEE Journal of Biomedical and Health Informatics.

[6]  Joachim M. Buhmann,et al.  The Balanced Accuracy and Its Posterior Distribution , 2010, 2010 20th International Conference on Pattern Recognition.

[7]  Anne E Carpenter,et al.  Reconstructing cell cycle and disease progression using deep learning , 2017, Nature Communications.

[8]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[9]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[10]  Anne E Carpenter,et al.  Improved structure, function and compatibility for CellProfiler: modular high-throughput image analysis software , 2011, Bioinform..

[11]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[12]  Anne E Carpenter,et al.  An open-source solution for advanced imaging flow cytometry data analysis using machine learning , 2017, Methods.

[13]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[14]  Nathalie Japkowicz,et al.  The class imbalance problem: A systematic study , 2002, Intell. Data Anal..

[15]  B. Gatto,et al.  DNA minor groove-binding ligands: a different class of mammalian DNA topoisomerase I inhibitors. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[16]  Mahesh Pal,et al.  Random forest classifier for remote sensing classification , 2005 .

[17]  S. Durham,et al.  Identification of T lymphocytes, macrophages, and activated eosinophils in the bronchial mucosa in intrinsic asthma. Relationship to symptoms and bronchial responsiveness. , 1992, The American review of respiratory disease.

[18]  Xinping Huang,et al.  Label-free imaging, detection, and mass measurement of single viruses by surface plasmon resonance , 2010, Proceedings of the National Academy of Sciences.

[19]  Y. Saeys,et al.  Computational flow cytometry: helping to make sense of high-dimensional immunology data , 2016, Nature Reviews Immunology.

[20]  Anne E Carpenter,et al.  Label-free cell cycle analysis for high-throughput imaging flow cytometry , 2016, Nature Communications.

[21]  Victor Alves,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images , 2016, IEEE Transactions on Medical Imaging.

[22]  Anne E Carpenter,et al.  Opportunities and obstacles for deep learning in biology and medicine , 2017, bioRxiv.

[23]  Ola Spjuth,et al.  Deep Learning in Image Cytometry: A Review , 2018, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[24]  Olaf Wolkenhauer,et al.  Diagnostic Potential of Imaging Flow Cytometry. , 2018, Trends in biotechnology.

[25]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Andrew Filby,et al.  Reporting imaging flow cytometry data for publication: Why mask the detail? , 2012, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[27]  Ondrej Bojar,et al.  Training Tips for the Transformer Model , 2018, Prague Bull. Math. Linguistics.

[28]  Matthew A. Rodrigues,et al.  Automation of the in vitro micronucleus assay using the Imagestream® imaging flow cytometer , 2018, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[29]  J. Dobrucki,et al.  Interaction of a DNA intercalator DRAQ5, and a minor groove binder SYTO17, with chromatin in live cells—Influence on chromatin organization and histone—DNA interactions , 2008, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[30]  Leland McInnes,et al.  UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction , 2018, ArXiv.

[31]  Huw Summers,et al.  An imaging flow cytometric method for measuring cell division history and molecular symmetry during mitosis , 2011, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[32]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[33]  Ramón Díaz-Uriarte,et al.  Gene selection and classification of microarray data using random forest , 2006, BMC Bioinformatics.

[34]  Facundo D. Batista,et al.  Asymmetric Segregation of Polarized Antigen on B Cell Division Shapes Presentation Capacity , 2012, Science.

[35]  Philipp Kukura,et al.  Dynamic label-free imaging of lipid nanodomains , 2015, Proceedings of the National Academy of Sciences.

[36]  Andrew Filby,et al.  Regulation of asymmetric cell division and polarity by Scribble is not required for humoral immunity , 2013, Nature Communications.

[37]  O. Stegle,et al.  Deep learning for computational biology , 2016, Molecular systems biology.

[38]  J Philip McCoy,et al.  Detection and Characterization of Rare Circulating Endothelial Cells by Imaging Flow Cytometry. , 2016, Methods in molecular biology.

[39]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  J. Friedman Stochastic gradient boosting , 2002 .

[41]  Mortazavi,et al.  Supporting Online Material Materials and Methods Figs. S1 to S13 Tables S1 to S3 References Label-free Biomedical Imaging with High Sensitivity by Stimulated Raman Scattering Microscopy , 2022 .