Reproducibility of Flow Cytometry Through Standardization: Opportunities and Challenges

There is an agreement in the field that interlaboratory reproducibility of flow cytometry measurements as well as the whole studies might be improved by a consensual use of methodological approach. Typically, a consensus is made on a crucial markers needed in the immunostaining panel, sometimes on the particular fluorochrome conjugates and rarely on a complete set of methods for sample preparation. The term “standardization” is used to describe the complete set of methodical steps, while “harmonization” is used for partial agreement on the method. Standardization can provide a platform for improved reproducibility of cytometry results over prolonged periods of time, across different sites and across different instruments. For the purpose of structured discussion, several desired aims are described: common interpretation of the immunophenotype definition of a target subset, accurate quantification, reproducible pattern of a multicolor immunophenotype, and reproducible intensity of all measured parameters. An overview of how standardization was approached by several large consortia is provided: EuroFlow, The ONE Study, Human Immunology Project Consortium (HIPC), and several other groups. Their particular aims and the tools adopted to reach those aims are noted. How those standardization efforts were adopted in the field and how the resulting outcome was evaluated is reviewed. Multiple challenges in the instrument hardware design, instrument setup tools, reagent design, and quality features need to be addressed to achieve optimal standardization. Furthermore, the aims of different studies vary, and thus, the reasonable requirements for standardization differ. A framework of reference for the reasonable outcomes of different approaches is offered. Finally, it is argued that complete standardization is important not only for the reproducibility of measurements but also for education, for quality assessment and for algorithmic data analysis. The different standardized approaches can and in fact should serve as benchmarking reference tools for the development of future flow cytometry studies. © 2019 International Society for Advancement of Cytometry

[1]  J. Reilly,et al.  UK NEQAS for leucocyte immunophenotyping: the first 10 years , 2001, Journal of clinical pathology.

[2]  S. Baumgart,et al.  OMIP‐034: Comprehensive immune phenotyping of human peripheral leukocytes by mass cytometry for monitoring immunomodulatory therapies , 2017, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[3]  Heavy metal contaminants can eliminate quantum dot fluorescence , 2011, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[4]  Raphael Gottardo,et al.  flowCL: ontology-based cell population labelling in flow cytometry , 2015, Bioinform..

[5]  B. Sawitzki,et al.  Standardized Multi-Color Flow Cytometry and Computational Biomarker Discovery. , 2016, Methods in molecular biology.

[6]  D. Barnett,et al.  Laboratory Accuracy Improvement in the UK NEQAS Leucocyte Immunophenotyping Immune Monitoring Program: An Eleven‐Year Review via Longitudinal Mixed Effects Modeling , 2018, Cytometry. Part B, Clinical cytometry.

[7]  M. Roederer How many events is enough? Are you positive? , 2008, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[8]  A Orfao,et al.  Next Generation Flow for highly sensitive and standardized detection of minimal residual disease in multiple myeloma , 2017, Leukemia.

[9]  A. Porwit,et al.  Validation of cell‐based fluorescence assays: Practice guidelines from the ICSH and ICCS – part III – analytical issues , 2013, Cytometry. Part B, Clinical cytometry.

[10]  A Orfao,et al.  EuroFlow: Resetting leukemia and lymphoma immunophenotyping. Basis for companion diagnostics and personalized medicine , 2012, Leukemia.

[11]  M. van der Burg,et al.  Optimization and testing of dried antibody tube: The EuroFlow LST and PIDOT tubes as examples. , 2017, Journal of immunological methods.

[12]  E. Montserrat,et al.  Improving efficiency and sensitivity: European Research Initiative in CLL (ERIC) update on the international harmonised approach for flow cytometric residual disease monitoring in CLL , 2013, Leukemia.

[13]  Shannon McWeeney,et al.  MIFlowCyt: The minimum information about a flow cytometry experiment , 2008, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[14]  Alberto Orfao,et al.  Minimal residual disease diagnostics in acute lymphoblastic leukemia: need for sensitive, fast, and standardized technologies. , 2015, Blood.

[15]  J. Reilly,et al.  Quality control of CD4+ T-lymphocyte enumeration: results from the last 9 years of the United Kingdom National External Quality Assessment Scheme for Immune Monitoring (1993-2001). , 2002, Cytometry.

[16]  R. Nussenblatt,et al.  Standardizing immunophenotyping for the Human Immunology Project , 2012, Nature Reviews Immunology.

[17]  H. Maecker,et al.  Selecting fluorochrome conjugates for maximum sensitivity , 2004, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[18]  Elena Blanco,et al.  The EuroFlow PID Orientation Tube for Flow Cytometric Diagnostic Screening of Primary Immunodeficiencies of the Lymphoid System , 2019, Front. Immunol..

[19]  Bertil Magnusson,et al.  Understanding the meaning of accuracy, trueness and precision , 2007 .

[20]  M. Keeney,et al.  Novel lymphocyte screening tube using dried monoclonal antibody reagents , 2015, Cytometry. Part B, Clinical cytometry.

[21]  M. van der Burg,et al.  Defects in memory B-cell and plasma cell subsets expressing different immunoglobulin-subclasses in patients with CVID and immunoglobulin subclass deficiencies. , 2019, The Journal of allergy and clinical immunology.

[22]  Jaebok Choi,et al.  OMIP‐042: 21‐color flow cytometry to comprehensively immunophenotype major lymphocyte and myeloid subsets in human peripheral blood , 2018, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[23]  V. Appay,et al.  Phenotype and function of human T lymphocyte subsets: Consensus and issues , 2008, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[24]  N. Packer,et al.  Specific Sialoforms Required for the Immune Suppressive Activity of Human Soluble CD52 , 2019, Front. Immunol..

[25]  R. Arceci,et al.  Clinical significance of minimal residual disease in childhood acute lymphoblastic leukemia and its relationship to other prognostic factors: a Children's Oncology Group study , 2009 .

[26]  Tomáš Kalina,et al.  How to make usage of the standardized EuroFlow 8-color protocols possible for instruments of different manufacturers. , 2017, Journal of immunological methods.

[27]  F Lacombe,et al.  Harmonemia: a universal strategy for flow cytometry immunophenotyping—A European LeukemiaNet WP10 study , 2016, Leukemia.

[28]  Ming Yan,et al.  Validation of cell‐based fluorescence assays: Practice guidelines from the ICSH and ICCS – part V – assay performance criteria , 2013, Cytometry. Part B, Clinical cytometry.

[29]  M. Loh,et al.  Prognostic significance of minimal residual disease in high risk B-ALL: a report from Children's Oncology Group study AALL0232. , 2015, Blood.

[30]  Andreas Grützkau,et al.  Stabilizing Antibody Cocktails for Mass Cytometry , 2019, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[31]  T. Kalina,et al.  EuroFlow standardization of flow cytometer instrument settings and immunophenotyping protocols , 2012, Leukemia.

[32]  E. Huys,et al.  Establishment of harmonization in immunophenotyping: A comparative study of a standardized one-tube lymphocyte-screening panel. , 2014, Cytometry. Part B, Clinical cytometry.

[33]  T. Eckschlager [CD nomenclature]. , 2003, Vnitrni lekarstvi.

[34]  Hannes Stockinger,et al.  CD Nomenclature 2015: Human Leukocyte Differentiation Antigen Workshops as a Driving Force in Immunology , 2015, The Journal of Immunology.

[35]  T. Kalina,et al.  Flow diagnostics essential code: A simple and brief format for the summary of leukemia phenotyping , 2014, Cytometry. Part B, Clinical cytometry.

[36]  Teri Oldaker,et al.  Validation of cell‐based fluorescence assays: Practice guidelines from the ICSH and ICCS – part I – rationale and aims , 2013, Cytometry. Part B, Clinical cytometry.

[37]  N. Aghaeepour,et al.  Thinking outside the gate: single-cell assessments in multiple dimensions. , 2015, Immunity.

[38]  Mario Roederer,et al.  OMIPs—Orchestrating multiplexity in polychromatic science , 2010, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[39]  Hana Glier,et al.  Standardization of 8-color flow cytometry across different flow cytometer instruments: A feasibility study in clinical laboratories in Switzerland. , 2017, Journal of immunological methods.

[40]  F. Rieux-Laucat,et al.  Autoimmune lymphoproliferative syndrome with somatic Fas mutations. , 2004, The New England journal of medicine.

[41]  M. van der Burg,et al.  Age‐associated distribution of normal B‐cell and plasma cell subsets in peripheral blood , 2018, The Journal of allergy and clinical immunology.

[42]  Lili Wang,et al.  Methodology for evaluating and comparing flow cytometers: A multisite study of 23 instruments , 2018, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[43]  T. Kalina,et al.  Frequent issues and lessons learned from EuroFlow QA. , 2018, Journal of immunological methods.

[44]  H. Maecker,et al.  A Model for Harmonizing Flow Cytometry in Clinical Trials , 2022 .

[45]  Carlos Eduardo Pedreira,et al.  A Multidimensional Classification Approach for the Automated Analysis of Flow Cytometry Data , 2008, IEEE Transactions on Biomedical Engineering.

[46]  F. Lacombe,et al.  Comparable flow cytometry data can be obtained with two types of instruments, Canto II, and Navios. A GEIL study , 2013, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[47]  M. van der Burg,et al.  Selection and validation of antibody clones against IgG and IgA subclasses in switched memory B-cells and plasma cells. , 2019, JIM - Journal of Immunological Methods.

[48]  Quentin Lecrevisse,et al.  Standardized flow cytometry for highly sensitive MRD measurements in B-cell acute lymphoblastic leukemia. , 2017, Blood.

[49]  I. Storie,et al.  Absolute CD4+ T‐lymphocyte and CD34+ stem cell counts by single‐platform flow cytometry: the way forward , 1999, British journal of haematology.

[50]  M. Jaimes,et al.  A harmonized approach to intracellular cytokine staining gating: Results from an international multiconsortia proficiency panel conducted by the Cancer Immunotherapy Consortium (CIC/CRI) , 2013, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[51]  A Orfao,et al.  EuroFlow antibody panels for standardized n-dimensional flow cytometric immunophenotyping of normal, reactive and malignant leukocytes , 2012, Leukemia.

[52]  J. P. McCoy,et al.  Standardizing Flow Cytometry Immunophenotyping Analysis from the Human ImmunoPhenotyping Consortium , 2016, Scientific Reports.

[53]  J. Paul Robinson,et al.  Guidelines for the use of flow cytometry and cell sorting in immunological studies. , 2017, European journal of immunology.

[54]  Holden T. Maecker,et al.  Erratum: Standardizing immunophenotyping for the Human Immunology Project , 2012, Nature Reviews Immunology.

[55]  James A. Hutchinson,et al.  Age and gender leucocytes variances and references values generated using the standardized ONE‐Study protocol , 2016, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[56]  J. Reilly,et al.  ISHAGE protocol: Are we doing it correctly? , 2012, Cytometry. Part B, Clinical cytometry.

[57]  S. Papa,et al.  Reduction of intra‐ and interlaboratory variation in CD34+ stem cell enumeration using stable test material, standard protocols and targeted training , 2000, British journal of haematology.

[58]  Jin-Yeong Han,et al.  Validation of cell‐based fluorescence assays: practice guidelines from the ICSH and ICCS – part II – preanalytical issues , 2013, Cytometry. Part B, Clinical cytometry.

[59]  R. Emerson,et al.  A complementary role of multiparameter flow cytometry and high-throughput sequencing for minimal residual disease detection in chronic lymphocytic leukemia: an European Research Initiative on CLL study , 2015, Leukemia.

[60]  W. V. van Wieringen,et al.  Flow cytometric CD34+ stem cell enumeration: Lessons from nine years' external quality assessment within the Benelux countries , 2007, Cytometry. Part B, Clinical cytometry.

[61]  F. Durrieu,et al.  Acceptable “Real‐Life” Variability for Lymphocyte Counts by Flow Cytometry , 2018, Cytometry. Part B, Clinical cytometry.

[62]  Antonio Cosma,et al.  Universal cell type identifier based on number theory , 2018, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[63]  T. Kalina,et al.  Common Variable Immunodeficiency patients with a phenotypic profile of immunosenescence present with thrombocytopenia , 2017, Scientific Reports.

[64]  Barbara Buldini,et al.  AIEOP‐BFM Consensus Guidelines 2016 for Flow Cytometric Immunophenotyping of Pediatric Acute Lymphoblastic Leukemia , 2018, Cytometry. Part B, Clinical cytometry.

[65]  Raphael Gottardo,et al.  Computational resources for high-dimensional immune analysis from the Human Immunology Project Consortium , 2014, Nature Biotechnology.

[66]  F. Preffer,et al.  Flow cytometry and the stability of phycoerythrin‐tandem dye conjugates , 2009, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[67]  D. Barnett,et al.  Validation of cell‐based fluorescence assays: Practice guidelines from the ICSH and ICCS – part IV – postanalytic considerations , 2013, Cytometry. Part B, Clinical cytometry.

[68]  Florian Mair,et al.  OMIP‐044: 28‐color immunophenotyping of the human dendritic cell compartment , 2018, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[69]  V. Maino,et al.  Standardization and optimization of multiparameter intracellular cytokine staining , 2008, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[70]  J Verde,et al.  Automated database-guided expert-supervised orientation for immunophenotypic diagnosis and classification of acute leukemia , 2017, Leukemia.

[71]  Kirsten E Diggins,et al.  Generating Quantitative Cell Identity Labels with Marker Enrichment Modeling (MEM) , 2018, Current protocols in cytometry.

[72]  C. Meisel,et al.  Standardization of whole blood immune phenotype monitoring for clinical trials: panels and methods from the ONE study , 2013, Transplantation research.

[73]  R. Hoffman,et al.  Determination of CD4 antigen density on cells: role of antibody valency, avidity, clones, and conjugation. , 1998, Cytometry.

[74]  F. Preijers,et al.  Establishment of harmonization in immunophenotyping: A comparative study of a standardized one‐tube lymphocyte‐screening panel , 2014 .

[75]  Kenneth D Cole,et al.  Human CD4+ lymphocytes for antigen quantification: Characterization using conventional flow cytometry and mass cytometry , 2012, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[76]  C. E. Pedreira,et al.  Quality assessment program for EuroFlow protocols: Summary results of four‐year (2010–2013) quality assurance rounds , 2015, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[77]  Barbara Buldini,et al.  Minimal residual disease analysis by eight-color flow cytometry in relapsed childhood acute lymphoblastic leukemia , 2015, Haematologica.

[78]  M. Roederer,et al.  Optimizing a multicolor immunophenotyping assay. , 2007, Clinics in laboratory medicine.

[79]  C. E. Pedreira,et al.  Lot-to-lot stability of antibody reagents for flow cytometry. , 2017, Journal of immunological methods.

[80]  M. van der Burg,et al.  EuroFlow-Based Flowcytometric Diagnostic Screening and Classification of Primary Immunodeficiencies of the Lymphoid System , 2019, Front. Immunol..

[81]  F. Sallusto,et al.  The who's who of T‐cell differentiation: Human memory T‐cell subsets , 2013, European journal of immunology.

[82]  Bruce Greig,et al.  2006 Bethesda International Consensus recommendations on the immunophenotypic analysis of hematolymphoid neoplasia by flow cytometry: Optimal reagents and reporting for the flow cytometric diagnosis of hematopoietic neoplasia , 2007, Cytometry. Part B, Clinical cytometry.

[83]  V. V. D. van der Velden,et al.  Fifteen years of external quality assessment in leukemia/lymphoma immunophenotyping in The Netherlands and Belgium: A way forward , 2016, Cytometry. Part B, Clinical cytometry.

[84]  Tomas Kalina,et al.  Relevance of Antibody Validation for Flow Cytometry , 2019, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[85]  Gary Kelloff,et al.  A QA Program for MRD Testing Demonstrates That Systematic Education Can Reduce Discordance Among Experienced Interpreters , 2018, Cytometry. Part B, Clinical cytometry.

[86]  R. Brant,et al.  A standardized immune phenotyping and automated data analysis platform for multicenter biomarker studies. , 2018, JCI insight.

[87]  Giuseppe Basso,et al.  Standardization of flow cytometric minimal residual disease evaluation in acute lymphoblastic leukemia: Multicentric assessment is feasible , 2008, Cytometry. Part B, Clinical cytometry.

[88]  J. Byrd,et al.  International standardized approach for flow cytometric residual disease monitoring in chronic lymphocytic leukaemia , 2007, Leukemia.

[89]  Christophe Jamin,et al.  Multi-center harmonization of flow cytometers in the context of the European "PRECISESADS" project. , 2016, Autoimmunity reviews.