Multivariate meta-analysis using individual participant data

When combining results across related studies, a multivariate meta‐analysis allows the joint synthesis of correlated effect estimates from multiple outcomes. Joint synthesis can improve efficiency over separate univariate syntheses, may reduce selective outcome reporting biases, and enables joint inferences across the outcomes. A common issue is that within‐study correlations needed to fit the multivariate model are unknown from published reports. However, provision of individual participant data (IPD) allows them to be calculated directly. Here, we illustrate how to use IPD to estimate within‐study correlations, using a joint linear regression for multiple continuous outcomes and bootstrapping methods for binary, survival and mixed outcomes. In a meta‐analysis of 10 hypertension trials, we then show how these methods enable multivariate meta‐analysis to address novel clinical questions about continuous, survival and binary outcomes; treatment–covariate interactions; adjusted risk/prognostic factor effects; longitudinal data; prognostic and multiparameter models; and multiple treatment comparisons. Both frequentist and Bayesian approaches are applied, with example software code provided to derive within‐study correlations and to fit the models. © 2014 The Authors. Research Synthesis Methods published by John Wiley & Sons, Ltd.

[1]  Dimitris Mavridis,et al.  Joint synthesis of multiple correlated outcomes in networks of interventions , 2014, Biostatistics.

[2]  Dimitris Mavridis,et al.  An approach for modelling multiple correlated outcomes in a network of interventions using odds ratios , 2014, Statistics in medicine.

[3]  Ingram Olkin,et al.  Bayesian network meta‐analysis for unordered categorical outcomes with incomplete data , 2014, Research synthesis methods.

[4]  Richard D Riley,et al.  Meta-analysis of test accuracy studies with multiple and missing thresholds : a multivariate-normal model , 2014 .

[5]  Thomas A Trikalinos,et al.  An empirical comparison of univariate and multivariate meta‐analyses for categorical outcomes , 2014, Statistics in medicine.

[6]  Oliver Kuss,et al.  Meta‐analysis for diagnostic accuracy studies: a new statistical model using beta‐binomial distributions and bivariate copulas , 2014, Statistics in medicine.

[7]  Daniel Jackson,et al.  A refined method for multivariate meta-analysis and meta-regression , 2013, Statistics in medicine.

[8]  Karel G M Moons,et al.  A framework for developing, implementing, and evaluating clinical prediction models in an individual participant data meta‐analysis , 2013, Statistics in medicine.

[9]  Yinghui Wei,et al.  Bayesian multivariate meta‐analysis with multiple outcomes , 2013, Statistics in medicine.

[10]  Richard D Riley,et al.  Meta‐analysis of randomised trials with a continuous outcome according to baseline imbalance and availability of individual participant data , 2013, Statistics in medicine.

[11]  Nicola J Cooper,et al.  Multivariate meta-analysis of mixed outcomes: a Bayesian approach , 2013, Statistics in medicine.

[12]  Catrin Tudur Smith,et al.  Combining individual patient data and aggregate data in mixed treatment comparison meta‐analysis: Individual patient data may be beneficial if only for a subset of trials , 2013, Statistics in medicine.

[13]  Thomas A Trikalinos,et al.  Empirical and Simulation-Based Comparison of Univariate and Multivariate Meta-Analysis for Binary Outcomes , 2013 .

[14]  Richard D Riley,et al.  A matrix-based method of moments for fitting the multivariate random effects model for meta-analysis and meta-regression , 2013, Biometrical journal. Biometrische Zeitschrift.

[15]  E. Steyerberg,et al.  Prognosis Research Strategy (PROGRESS) 3: Prognostic Model Research , 2013, PLoS medicine.

[16]  A. Sutton,et al.  Mixed treatment comparisons using aggregate and individual participant level data , 2012, Statistics in medicine.

[17]  Yinghui Wei,et al.  Estimating within-study covariances in multivariate meta-analysis with multiple outcomes , 2012, Statistics in medicine.

[18]  Josée Dupuis,et al.  A Method of Moments Estimator for Random Effect Multivariate Meta‐Analysis , 2012, Biometrics.

[19]  Richard D Riley,et al.  A multivariate meta‐analysis approach for reducing the impact of outcome reporting bias in systematic reviews , 2012, Statistics in medicine.

[20]  Yvonne Vergouwe,et al.  Incorporating published univariable associations in diagnostic and prognostic modeling , 2012, BMC Medical Research Methodology.

[21]  Ingram Olkin,et al.  Meta-analysis of effect sizes reported at multiple time points: A multivariate approach , 2012, Clinical trials.

[22]  A Gasparrini,et al.  Multivariate meta-analysis for non-linear and other multi-parameter associations , 2012, Statistics in medicine.

[23]  I. White,et al.  Quantifying the impact of between-study heterogeneity in multivariate meta-analyses , 2012, Statistics in medicine.

[24]  Georgia Salanti,et al.  Indirect and mixed‐treatment comparison, network, or multiple‐treatments meta‐analysis: many names, many benefits, many concerns for the next generation evidence synthesis tool , 2012, Research synthesis methods.

[25]  Dan Jackson,et al.  Consistency and inconsistency in network meta-analysis: model estimation using multivariate meta-regression‡ , 2012, Research synthesis methods.

[26]  Richard D Riley,et al.  Individual patient data meta-analysis of survival data using Poisson regression models , 2012, BMC Medical Research Methodology.

[27]  Patrick Royston,et al.  A new strategy for meta‐analysis of continuous covariates in observational studies , 2011, Statistics in medicine.

[28]  Madhu Mazumdar,et al.  Multivariate meta‐analysis: a robust approach based on the theory of U‐statistic , 2011, Statistics in medicine.

[29]  Richard D Riley,et al.  Rejoinder to commentaries on ‘Multivariate meta‐analysis: Potential and promise’ , 2011 .

[30]  A Gasparrini,et al.  Multivariate meta‐analysis: A method to summarize non‐linear associations , 2011, Statistics in medicine.

[31]  Malcolm J Price,et al.  Parameterization of treatment effects for meta‐analysis in multi‐state Markov models , 2011, Statistics in medicine.

[32]  Dan Jackson,et al.  Multivariate meta-analysis: Potential and promise , 2011, Statistics in medicine.

[33]  Theo Stijnen,et al.  Random effects meta‐analysis of event outcome in the framework of the generalized linear mixed model with applications in sparse data , 2010, Statistics in medicine.

[34]  Nicky J Welton,et al.  Network meta-analysis with competing risk outcomes. , 2010, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[35]  Stephen Kaptoge,et al.  Statistical methods for the time-to-event analysis of individual participant data from multiple epidemiological studies , 2010, International journal of epidemiology.

[36]  R. Riley,et al.  Meta-analysis of individual participant data: rationale, conduct, and reporting , 2010, BMJ : British Medical Journal.

[37]  S. Senn Hans van Houwelingen and the Art of Summing up , 2010, Biometrical journal. Biometrische Zeitschrift.

[38]  Richard D Riley,et al.  Multivariate meta‐analysis: the effect of ignoring within‐study correlation , 2009 .

[39]  M. Buyse Use of Meta-Analysis for the Validation of Surrogate Endpoints and Biomarkers in Cancer Trials , 2009, Cancer journal.

[40]  Dan Jackson,et al.  Extending DerSimonian and Laird's methodology to perform multivariate random effects meta‐analyses , 2009, Statistics in medicine.

[41]  Tomasz Burzykowski,et al.  Surrogate endpoints for overall survival in locally advanced head and neck cancer: meta-analyses of individual patient data. , 2009, The Lancet. Oncology.

[42]  H Tunstall-Pedoe,et al.  Systematically missing confounders in individual participant data meta-analysis of observational cohort studies , 2009, Statistics in medicine.

[43]  A. Whitehead,et al.  Meta-analysis of individual patient data versus aggregate data from longitudinal clinical trials , 2009, Clinical trials.

[44]  Theo Stijnen,et al.  Meta‐analysis of summary survival curve data , 2008, Statistics in medicine.

[45]  Ingram Olkin,et al.  A method for the meta‐analysis of mutually exclusive binary outcomes , 2008, Statistics in medicine.

[46]  Dan Jackson,et al.  A new approach to outliers in meta-analysis , 2008, Health care management science.

[47]  Richard D Riley,et al.  Meta‐analysis of continuous outcomes combining individual patient data and aggregate data , 2008, Statistics in medicine.

[48]  A J Sutton,et al.  Meta‐analysis of individual‐ and aggregate‐level data , 2008, Statistics in medicine.

[49]  Simon G Thompson,et al.  Flexible parametric models for random‐effects distributions , 2008, Statistics in medicine.

[50]  M C Simmonds,et al.  Covariate heterogeneity in meta‐analysis: Criteria for deciding between meta‐regression and individual patient data , 2007, Statistics in medicine.

[51]  H Putter,et al.  Tutorial in biostatistics: competing risks and multi‐state models , 2007, Statistics in medicine.

[52]  Richard D Riley,et al.  Evidence synthesis combining individual patient data and aggregate data: a systematic review identified current practice and possible methods. , 2007, Journal of clinical epidemiology.

[53]  Roger M Harbord,et al.  A unification of models for meta-analysis of diagnostic accuracy studies. , 2007, Biostatistics.

[54]  P C Lambert,et al.  An evaluation of bivariate random‐effects meta‐analysis for the joint synthesis of two correlated outcomes , 2007, Statistics in medicine.

[55]  Richard D Riley,et al.  Beyond the Bench: Hunting Down Fugitive Literature , 2004, Environmental Health Perspectives.

[56]  Sylvia Richardson,et al.  Improving ecological inference using individual‐level data , 2006, Statistics in medicine.

[57]  Johannes B Reitsma,et al.  Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. , 2005, Journal of clinical epidemiology.

[58]  David R. Jones,et al.  How vague is vague? A simulation study of the impact of the use of vague prior distributions in MCMC using WinBUGS , 2005, Statistics in medicine.

[59]  Richard D Riley,et al.  Meta‐analysis of genetic studies using Mendelian randomization—a multivariate approach , 2005, Statistics in medicine.

[60]  Mark C Simmonds,et al.  Meta-analysis of individual patient data from randomized trials: a review of methods used in practice , 2005, Clinical trials.

[61]  François Gueyffier,et al.  Systolic and Diastolic Blood Pressure Lowering as Determinants of Cardiovascular Outcome , 2005, Hypertension.

[62]  Kerrie Mengersen,et al.  Multivariate meta‐analysis , 2003, Statistics in medicine.

[63]  Theo Stijnen,et al.  Advanced methods in meta‐analysis: multivariate approach and meta‐regression , 2002, Statistics in medicine.

[64]  Harold I Feldman,et al.  Individual patient‐ versus group‐level data meta‐regressions for the investigation of treatment effect modifiers: ecological bias rears its ugly head , 2002, Statistics in medicine.

[65]  Philip Hougaard,et al.  Analysis of Multivariate Survival Data , 2001 .

[66]  A Whitehead,et al.  Meta‐analysis of continuous outcome data from individual patients , 2001, Statistics in medicine.

[67]  Xiao-Li Meng,et al.  Modeling covariance matrices in terms of standard deviations and correlations, with application to shrinkage , 2000 .

[68]  R J Carroll,et al.  On meta-analytic assessment of surrogate outcomes. , 2000, Biostatistics.

[69]  G. Molenberghs,et al.  The validation of surrogate endpoints in meta-analyses of randomized experiments. , 2000, Biostatistics.

[70]  E W Steyerberg,et al.  See Blockindiscussions, Blockinstats, Blockinand Blockinauthor Blockinprofiles Blockinfor Blockinthis Blockinpublication Prognostic Blockinmodels Blockinbased Blockinon Blockinliterature Blockinand Individual Blockinpatient Blockindata Blockinin Blockinlogistic Blockinregression Analysis Article Blo , 2022 .

[71]  J A Staessen,et al.  Comparison of active treatment and placebo in older Chinese patients with isolated systolic hypertension , 1998, Journal of hypertension.

[72]  M J Daniels,et al.  Meta-analysis for the evaluation of potential surrogate markers. , 1997, Statistics in medicine.

[73]  Jan A Staessen,et al.  Randomised double-blind comparison of placebo and active treatment for older patients with isolated systolic hypertension , 1997, The Lancet.

[74]  C S Berkey,et al.  Multiple-outcome meta-analysis of clinical trials. , 1996, Statistics in medicine.

[75]  S. Pocock,et al.  INDANA: a meta-analysis on individual patient data in hypertension. Protocol and preliminary results. , 1995, Therapie.

[76]  D. Hoaglin,et al.  Multiple-outcomes Meta-analysis of Treatments for Periodontal Disease , 1995, Journal of dental research.

[77]  K. Dear,et al.  Iterative generalized least squares for meta-analysis of survival data at multiple times. , 1994, Biometrics.

[78]  H C Van Houwelingen,et al.  A bivariate approach to meta-analysis. , 1993, Statistics in medicine.

[79]  M. Moeschberger,et al.  A bivariate survival model with modified gamma frailty for assessing the impact of interventions. , 1993, Statistics in medicine.

[80]  S. Greenland,et al.  Methods for trend estimation from summarized dose-response data, with applications to meta-analysis. , 1992, American journal of epidemiology.

[81]  N. Laird,et al.  Meta-analysis in clinical trials. , 1986, Controlled clinical trials.

[82]  C. Bulpitt,et al.  Mortality and Morbidity Results from the European Working Party on High Blood Pressure in the Elderly Trial , 1985, The Lancet.

[83]  N. Breslow,et al.  Analysis of Survival Data under the Proportional Hazards Model , 1975 .

[84]  Ian R. White,et al.  Multivariate Random-effects Meta-analysis , 2009 .

[85]  H. V. Houwelingen,et al.  Multivariate random effects meta-analysis of diagnostic tests with multiple thresholds , 2015 .

[86]  Nicola Orsini,et al.  Meta-analysis for linear and nonlinear dose-response relations: examples, an evaluation of approximations, and software. , 2012, American journal of epidemiology.

[87]  Virginie Rondeau,et al.  A joint model for the dependence between clustered times to tumour progression and deaths: A meta-analysis of chemotherapy in head and neck cancer , 2015, Statistical methods in medical research.

[88]  Richard D Riley,et al.  Meta‐analysis of a binary outcome using individual participant data and aggregate data , 2010, Research synthesis methods.

[89]  Richard D Riley,et al.  An alternative model for bivariate random-effects meta-analysis when the within-study correlations are unknown. , 2008, Biostatistics.

[90]  Theo Stijnen,et al.  The binomial distribution of meta-analysis was preferred to model within-study variability. , 2008, Journal of clinical epidemiology.

[91]  G. Molenberghs,et al.  Validation of surrogate end points in multiple randomized clinical trials with failure time end points , 2001 .

[92]  Betsy Jane Becker,et al.  Multivariate meta-analysis. , 2000 .

[93]  E. O’Brien,et al.  Randomised double-blind comparison of placebo and active treatment for older patients with isolated systolic hypertension. The Systolic Hypertension in Europe (Syst-Eur) Trial Investigators. , 1997, Lancet.

[94]  Betsy Jane Becker,et al.  Modeling multivariate effect sizes. , 1988 .

[95]  S Greenland,et al.  Quantitative methods in the review of epidemiologic literature. , 1987, Epidemiologic reviews.

[96]  D. Cox Regression Models and Life-Tables , 1972 .

[97]  D.,et al.  Regression Models and Life-Tables , 2022 .