Precision and linearity targets for validation of an IFNγ ELISPOT, cytokine flow cytometry, and tetramer assay using CMV peptides

BackgroundSingle-cell assays of immune function are increasingly used to monitor T cell responses in immunotherapy clinical trials. Standardization and validation of such assays are therefore important to interpretation of the clinical trial data. Here we assess the levels of intra-assay, inter-assay, and inter-operator precision, as well as linearity, of CD8+ T cell IFNγ-based ELISPOT and cytokine flow cytometry (CFC), as well as tetramer assays.ResultsPrecision was measured in cryopreserved PBMC with a low, medium, or high response level to a CMV pp65 peptide or peptide mixture. Intra-assay precision was assessed using 6 replicates per assay; inter-assay precision was assessed by performing 8 assays on different days; and inter-operator precision was assessed using 3 different operators working on the same day. Percent CV values ranged from 4% to 133% depending upon the assay and response level. Linearity was measured by diluting PBMC from a high responder into PBMC from a non-responder, and yielded R2 values from 0.85 to 0.99 depending upon the assay and antigen.ConclusionThese data provide target values for precision and linearity of single-cell assays for those wishing to validate these assays in their own laboratories. They also allow for comparison of the precision and linearity of ELISPOT, CFC, and tetramer across a range of response levels. There was a trend toward tetramer assays showing the highest precision, followed closely by CFC, and then ELISPOT; while all three assays had similar linearity. These findings are contingent upon the use of optimized protocols for each assay.

[1]  J. M. Christensen,et al.  Evaluation of Accuracy and Uncertainty of ELISA Assays for the Determination of Interleukin-4, Interleukin-5, Interferon-γ and Tumor Necrosis Factor-α , 2002 .

[2]  B. Ferruà,et al.  Reverse ELISPOT assay for clonal analysis of cytokine production. II. Enumeration of interleukin-1-secreting cells by amplified (avidin-biotin anti-peroxidase) assay. , 1992, Journal of immunological methods.

[3]  Elizabeth Sinclair,et al.  Comparison of the ELISPOT and cytokine flow cytometry assays for the enumeration of antigen-specific T cells. , 2003, Journal of immunological methods.

[4]  D. Nixon,et al.  Rapid quantification of SIV-specific CD8 T cell responses with recombinant vaccinia virus ELISPOT or cytokine flow cytometry. , 2000, AIDS.

[5]  N. Greenspan,et al.  Pretransplant frequency of donor-specific, IFN-gamma-producing lymphocytes is a manifestation of immunologic memory and correlates with the risk of posttransplant rejection episodes. , 1999, Journal of immunology.

[6]  M. Altfeld,et al.  Standardization of cytokine flow cytometry assays , 2005, BMC Immunology.

[7]  E. Thiel,et al.  Flow cytometric determination of intracellular or secreted IFNgamma for the quantification of antigen reactive T cells. , 2001, Journal of immunological methods.

[8]  C. Pitcher,et al.  Determination of antigen-specific memory/effector CD4+ T cell frequencies by flow cytometry: evidence for a novel, antigen-specific homeostatic mechanism in HIV-associated immunodeficiency. , 1997, The Journal of clinical investigation.

[9]  O Ouchterlony,et al.  Reverse ELISPOT assay for clonal analysis of cytokine production. I. Enumeration of gamma-interferon-secreting cells. , 1988, Journal of immunological methods.

[10]  J. Schneider-Mergener,et al.  T-cell epitope mapping by flow cytometry , 1998, Nature Medicine.

[11]  L. Picker,et al.  Cytomegalovirus (CMV) phosphoprotein 65 makes a large contribution to shaping the T cell repertoire in CMV-exposed individuals. , 2002, The Journal of infectious diseases.

[12]  J. W. Findlay,et al.  Validation of immunoassays for bioanalysis: a pharmaceutical industry perspective. , 2000, Journal of pharmaceutical and biomedical analysis.

[13]  Guido Ferrari,et al.  Results of an ELISPOT proficiency panel conducted in 11 laboratories participating in international human immunodeficiency virus type 1 vaccine trials. , 2005, AIDS research and human retroviruses.

[14]  V. Maino,et al.  Detection of antigen-specific T cell cytokine expression in whole blood by flow cytometry. , 1998, Journal of immunological methods.

[15]  J. Lathey Preliminary steps toward validating a clinical bioassay: A case study of the ELIspot assay , 2003 .

[16]  A. Samri,et al.  Evaluation of the Interlaboratory Concordance in Quantification of Human Immunodeficiency Virus-Specific T Cells with a Gamma Interferon Enzyme-Linked Immunospot Assay , 2006, Clinical and Vaccine Immunology.

[17]  W. Alvord,et al.  Adjuvant immunization of HLA-A2-positive melanoma patients with a modified gp100 peptide induces peptide-specific CD8+ T-cell responses. , 2003, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[18]  H. Maecker The Role of Immune Monitoring in Evaluating Cancer Immunotherapy , 2006 .

[19]  D. Niedzwiecki,et al.  Enumerating Antigen-Specific T-Cell Responses in Peripheral Blood: A Comparison of Peptide MHC Tetramer, ELISpot, and Intracellular Cytokine Analysis , 2005, Journal of immunotherapy.

[20]  T. Rourke,et al.  Detection of antigen-specific T cell interferon gamma expression by ELISPOT and cytokine flow cytometry assays in rhesus macaques. , 2003, Journal of immunological methods.

[21]  E. Thiel,et al.  Flow cytometric determination of intracellular or secreted IFNgamma for the quantification of antigen reactive T cells. , 2001, Journal of immunological methods.

[22]  B. Boehm,et al.  Direct Visualization of Cytokine-Producing Recall Antigen-Specific CD4 Memory T Cells in Healthy Individuals and HIV Patients1 , 2000, The Journal of Immunology.

[23]  H. Maecker,et al.  Optimization of whole blood antigen-specific cytokine assays for CD4(+) T cells. , 2000, Cytometry.

[24]  M. Owens,et al.  Validation and quality control of immunophenotyping in clinical flow cytometry. , 2000, Journal of immunological methods.

[25]  K. Fujii,et al.  Rapid determination of Epstein-Barr virus-specific CD8(+) T-cell frequencies by flow cytometry. , 1999, Blood.

[26]  V. Maino,et al.  Enhancement of HIV type 1 antigen-specific CD4+ T cell memory in subjects with chronic HIV type 1 infection receiving an HIV type 1 immunogen. , 2000, AIDS research and human retroviruses.

[27]  D. Ankerst,et al.  Impact of cryopreservation on tetramer, cytokine flow cytometry, and ELISPOT , 2005, BMC Immunology.

[28]  T. Whiteside,et al.  Enzyme-linked immunospot, cytokine flow cytometry, and tetramers in the detection of T-cell responses to a dendritic cell-based multipeptide vaccine in patients with melanoma. , 2003, Clinical cancer research : an official journal of the American Association for Cancer Research.

[29]  K. Fujii,et al.  Rapid Determination of Epstein-Barr Virus–Specific CD8+T-Cell Frequencies by Flow Cytometry , 1999 .

[30]  G. Carcelain,et al.  A systematic comparison of methods to measure HIV-1 specific CD8 T cells. , 2003, Journal of immunological methods.

[31]  Philip J. R. Goulder,et al.  Phenotypic Analysis of Antigen-Specific T Lymphocytes , 1996, Science.