Normalization and Statistical Analysis of Multiplexed Bead-based Immunoassay Data Using Mixed-effects Modeling*

Multiplexed bead-based flow cytometric immunoassays are a powerful experimental tool for investigating cellular communication networks, yet their widespread adoption is limited in part by challenges in robust quantitative analysis of the measurements. Here we report our application of mixed-effects modeling for the normalization and statistical analysis of bead-based immunoassay data. Our data set consisted of bead-based immunoassay measurements of 16 phospho-proteins in lysates of HepG2 cells treated with ligands that regulate acute-phase protein secretion. Mixed-effects modeling provided estimates for the effects of both the technical and biological sources of variance, and normalization was achieved by subtracting the technical effects from the measured values. This approach allowed us to detect ligand effects on signaling with greater precision and sensitivity and to more accurately characterize the HepG2 cell signaling network using constrained fuzzy logic. Mixed-effects modeling analysis of our data was vital for ascertaining that IL-1α and TGF-α treatment increased the activities of more pathways than IL-6 and TNF-α and that TGF-α and TNF-α increased p38 MAPK and c-Jun N-terminal kinase (JNK) phospho-protein levels in a synergistic manner. Moreover, we used mixed-effects modeling-based technical effect estimates to reveal the substantial variance contributed by batch effects along with the absence of loading order and assay plate position effects. We conclude that mixed-effects modeling enabled additional insights to be gained from our data than would otherwise be possible and we discuss how this methodology can play an important role in enhancing the value of experiments employing multiplexed bead-based immunoassays.

[1]  B. Hanley.  Variance in multiplex suspension array assays: carryover of microspheres between sample wells , 2007, Journal of Negative Results in BioMedicine.

[2]  N. W. Galwey,et al.  Introduction to mixed modelling , 2006 .

[3]  Olga Vitek,et al.  Noise reduction in genome-wide perturbation screens using linear mixed-effect models , 2011, Bioinform..

[4]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[5]  Pierre R. Bushel,et al.  Assessing Gene Significance from cDNA Microarray Expression Data via Mixed Models , 2001, J. Comput. Biol..

[6]  Jens Timmer,et al.  An error model for protein quantification , 2007, Bioinform..

[7]  Charles E. Heckler,et al.  Introduction to Mixed Modelling. Beyond Regression and Analysis of Variance , 2008, Technometrics.

[8]  W. Hörl,et al.  Effect of leptin on polymorphonuclear leucocyte functions in healthy subjects and haemodialysis patients. , 2011, Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association.

[9]  J. Downward.  The ins and outs of signalling , 2001, Nature.

[10]  Marie Reilly,et al.  Validation of peptide epitope microarray experiments and extraction of quality data. , 2007, Journal of immunological methods.

[11]  K. Yamamoto,et al.  Crosstalk in inflammation: the interplay of glucocorticoid receptor-based mechanisms and kinases and phosphatases. , 2009, Endocrine reviews.

[12]  J. Robotham,et al.  The acute-phase response. , 1995, New horizons.

[13]  Meijing Wang,et al.  MEK mediates the novel cross talk between TNFR2 and TGF-EGFR in enhancing vascular endothelial growth factor (VEGF) secretion from human mesenchymal stem cells. , 2009, Surgery.

[14]  P. Colville-Nash,et al.  BMP-7 and Proximal Tubule Epithelial Cells: Activation of Multiple Signaling Pathways Reveals a Novel Anti-fibrotic Mechanism , 2008, Pharmaceutical Research.

[15]  Karen A. F. Copeland.  Design and Analysis of Experiments, 5th Ed. , 2001 .

[16]  D. Lauffenburger,et al.  Physicochemical modelling of cell signalling pathways , 2006, Nature Cell Biology.

[17]  P. Luciw,et al.  Multiplexed microbead immunoassays by flow cytometry for molecular profiling: Basic concepts and proteomics applications , 2009, Critical reviews in biotechnology.

[18]  Juan Lin,et al.  Multi-level mixed effects models for bead arrays , 2011, Bioinform..

[19]  Julio Saez-Rodriguez,et al.  Training Signaling Pathway Maps to Biochemical Data with Constrained Fuzzy Logic: Quantitative Analysis of Liver Cell Responses to Inflammatory Stimuli , 2011, PLoS Comput. Biol..

[20]  H. Kung,et al.  Multiplex analysis of Src family kinase signaling by microbead suspension arrays. , 2010, Assay and drug development technologies.

[21]  A. Scheffold,et al.  Origin and functional activity of the membrane-bound glucocorticoid receptor. , 2011, Arthritis and rheumatism.

[22]  Peter K. Sorger,et al.  Logic-Based Models for the Analysis of Cell Signaling Networks† , 2010, Biochemistry.

[23]  M. Crawley.  Mixed‐Effects Models , 2007 .

[24]  B. Ripley,et al.  Semiparametric Regression: Preface , 2003 .

[25]  D. Meldrum,et al.  MEK, p38, and PI-3K mediate cross talk between EGFR and TNFR in enhancing hepatocyte growth factor production from human mesenchymal stem cells. , 2009, American journal of physiology. Cell physiology.

[26]  Thomas Streichert,et al.  MicroRNA profiling using fluorescence-labeled beads: data acquisition and processing. , 2011, Methods in molecular biology.

[27]  Robert Nadon,et al.  Statistical practice in high-throughput screening data analysis , 2006, Nature Biotechnology.

[28]  Gary A. Churchill,et al.  Analysis of Variance for Gene Expression Microarray Data , 2000, J. Comput. Biol..

[29]  Guilherme J M Rosa,et al.  A powerful and flexible linear mixed model framework for the analysis of relative quantification RT-PCR data. , 2009, Genomics.

[30]  John D. Storey,et al.  Supervised normalization of microarrays , 2010, Bioinform..

[31]  Mark M. Davis,et al.  Significance analysis of xMap cytokine bead arrays , 2012, Proceedings of the National Academy of Sciences.

[32]  David M. Simcha,et al.  Tackling the widespread and critical impact of batch effects in high-throughput data , 2010, Nature Reviews Genetics.

[33]  Luke Chang,et al.  Mixed Effects Modeling in R , 2010 .

[34]  C. Ramacci,et al.  P53 and PTEN expression contribute to the inhibition of EGFR downstream signaling pathway by cetuximab , 2009, Cancer Gene Therapy.

[35]  Kevin A Janes,et al.  A biological approach to computational models of proteomic networks. , 2006, Current opinion in chemical biology.

[36]  R. V. van Etten,et al.  Modulation of hepatic acute phase gene expression by epidermal growth factor and src protein tyrosine kinases in murine and human hepatic cells , 1999, Hepatology.

[37]  Stanley E Lazic,et al.  The problem of pseudoreplication in neuroscientific studies: is it affecting your analysis? , 2010, BMC Neuroscience.

[38]  Hongkai Ji,et al.  Analyzing 'omics data using hierarchical models , 2010, Nature Biotechnology.

[39]  D. Bates,et al.  Mixed-Effects Models in S and S-PLUS , 2001 .

[40]  Margaret J. Robertson,et al.  Design and Analysis of Experiments , 2006, Handbook of statistics.

[41]  P. Sorger,et al.  Systems biology and combination therapy in the quest for clinical efficacy , 2006, Nature chemical biology.

[42]  E. Falkenstein,et al.  Nongenomic steroid action: controversies, questions, and answers. , 2003, Physiological reviews.

[43]  J. Krystal,et al.  Move over ANOVA: progress in analyzing repeated-measures data and its reflection in papers published in the Archives of General Psychiatry. , 2004, Archives of general psychiatry.

[44]  Derek V. Byrne,et al.  Power of experimental designs, estimated by Monte Carlo simulation , 2000 .

[45]  D. Figeys,et al.  Srf1 Is a Novel Regulator of Phospholipase D Activity and Is Essential to Buffer the Toxic Effects of C16:0 Platelet Activating Factor , 2011, PLoS genetics.

[46]  Michael B. Yaffe,et al.  Data-driven modelling of signal-transduction networks , 2006, Nature Reviews Molecular Cell Biology.

[47]  D. C. Clarke,et al.  Multi-pathway network analysis of mammalian epithelial cell responses in inflammatory environments. , 2012, Biochemical Society transactions.

[48]  T. Joos,et al.  Multiplex microsphere‐based flow cytometric platforms for protein analysis and their application in clinical proteomics – from assays to results , 2009, Electrophoresis.

[49]  P. Elvin,et al.  Src inhibitors in early breast cancer: a methodology, feasibility and variability study , 2009, Breast Cancer Research and Treatment.