Measurement and quality control issues in multiplex protein assays: a case study.

BACKGROUND Multiplex arrays are increasingly used for measuring protein biomarkers. Advantages of this approach include specimen conservation, limited sample handling, and decreased time and cost, but the challenges of optimizing assay format for each protein, selecting common dilution factors, and establishing robust quality control algorithms are substantial. Here, we use measurements of 15 protein biomarkers from a large study to illustrate processing, analytic, and quality control issues with multiplexed immunoassays. METHODS We contracted with ThermoScientific for duplicate measurements of 15 proteins in 2322 participants from a community-based cohort, a plasma control, and recombinant protein controls using 2 custom planar microarrays with 6 (panel A) or 9 (panel B) capture antibodies printed in each well. We selected constituent analytes in each panel based on endogenous concentrations and assay availability. Protocols were standardized for sample processing, storage, and freeze-thaw exposures. We analyzed data for effects of deviations from processing protocols, precision, and bias. RESULTS Measurements were within reportable ranges for each of the assays; however, concentrations for 7 of the 15 proteins were not centered on the dose-response curves. An additional freeze-thaw cycle and erroneous sample dilution for a subset of samples produced significantly different results. Measurements with large differences between duplicates were seen to cluster by analyte, plate, and participant. Conventional univariate quality control algorithms rejected many plates. Plate-specific medians of cohort and plasma control data significantly covaried, an observation important for development of alternative quality control algorithms. CONCLUSIONS Multiplex measurements present difficult challenges that require further analytical and statistical developments.

[1]  D. Seligson,et al.  Clinical Chemistry , 1965, Bulletin de la Societe de chimie biologique.

[2]  Steven C. Hunt,et al.  Multi-center genetic study of hypertension: The Family Blood Pressure Program (FBPP). , 2002, Hypertension.

[3]  D. Shlaes,et al.  A Pharmaceutical Industry Perspective , 2004 .

[4]  T. Grosser,et al.  Role of Prostacyclin in the Cardiovascular Response to Thromboxane A2 , 2002, Science.

[5]  Barry Schweitzer,et al.  Measuring proteins on microarrays. , 2002, Current opinion in biotechnology.

[6]  Duccio Cavalieri,et al.  Standards for Microarray Data , 2002, Science.

[7]  Paul Hasler,et al.  Protein microarray platform for the multiplex analysis of biomarkers in human sera. , 2006, Journal of immunological methods.

[8]  Harvey B Pollard,et al.  Protein microarray platforms for clinical proteomics , 2007, Proteomics. Clinical applications.

[9]  Lei Guo,et al.  The MicroArray Quality Control (MAQC) Project and Cross-Platform Analysis of Microarray Data , 2011, Handbook of Statistical Bioinformatics.

[10]  Karl Voelkerding,et al.  Validating a custom multiplex ELISA against individual commercial immunoassays using clinical samples. , 2007, BioTechniques.

[11]  Gail Javitt.  Law and policy director Gail Javitt public comments on FDA's Draft Guidance for Industry and FDA Staff: Pharmacogenetic Tests and Genetic Tests for Heritable Markers , 2006 .

[12]  C. Wagner,et al.  Simultaneous Detection of Eight Analytes in Human Serum by Two Commercially Available Platforms for Multiplex Cytokine Analysis , 2007, Clinical and Vaccine Immunology.

[13]  Hanlee P. Ji,et al.  The MicroArray Quality Control (MAQC) project shows inter- and intraplatform reproducibility of gene expression measurements. , 2006, Nature biotechnology.

[14]  Giuseppe Lippi,et al.  Relationship between matrix metalloproteinases/tissue inhibitors of matrix metalloproteinases systems and autoantibody patterns in systemic sclerosis. , 2007, Clinical biochemistry.

[15]  Manfred Weiss,et al.  Suspension microarrays for the identification of the response patterns in hyperinflammatory diseases. , 2008, Medical engineering & physics.

[16]  D. Ransohoff.  Bias as a threat to the validity of cancer molecular-marker research , 2005, Nature reviews. Cancer.

[17]  Steven A Carr,et al.  Protein biomarker discovery and validation: the long and uncertain path to clinical utility , 2006, Nature Biotechnology.

[18]  The External Rna Controls Consortium.  The External RNA Controls Consortium: a progress report , 2005 .

[19]  Yudong D. He,et al.  Gene expression profiling predicts clinical outcome of breast cancer , 2002, Nature.

[20]  Maqc Consortium.  The MicroArray Quality Control (MAQC) project shows inter- and intraplatform reproducibility of gene expression measurements , 2006, Nature Biotechnology.

[21]  J. W. Findlay,et al.  Validation of immunoassays for bioanalysis: a pharmaceutical industry perspective. , 2000, Journal of pharmaceutical and biomedical analysis.