Individual patient data meta‐analysis of time‐to‐event outcomes: one‐stage versus two‐stage approaches for estimating the hazard ratio under a random effects model

Meta-analyses of individual patient data (IPD) provide a strong and authoritative basis for evidence synthesis. IPD are particularly useful when the outcome of interest is the time to an event. Methodological developments now enable the meta-analysis of time-to-event IPD using a single model, allowing treatment effect and across-trial heterogeneity parameters to be estimated simultaneously. This differs from the standard approaches used with aggregate data, and also predominantly with IPD. Facilitated by a simulation study, we investigate what these new 'one-stage' random-effects models offer over standard 'two-stage' approaches. We find that two-stage approaches represent a robust, reliable and easily implementable way to estimate treatment effects and account for heterogeneity. Nevertheless, one-stage models can be used to provide a deeper insight into the data. Software for fitting one-stage Cox models with random effects using Restricted Maximum Likelihood methodology is made available, and its use demonstrated on an IPD meta-analysis assessing post-operative radio therapy for patients with non-small cell lung cancer. Copyright © 2011 John Wiley & Sons, Ltd.

[1]  David R. Cox,et al.  Regression models and life tables (with discussion , 1972 .

[2]  J F Tierney,et al.  A critical review of methods for the assessment of patient-level interactions in individual participant data meta-analysis of randomized trials, and guidance for practitioners. , 2011, Journal of clinical epidemiology.

[3]  P C Lambert,et al.  A comparison of summary patient-level covariates in meta-regression with individual patient data meta-analysis. , 2002, Journal of clinical epidemiology.

[4]  D J Sargent,et al.  A general framework for random effects survival analysis in the Cox proportional hazards setting. , 1998, Biometrics.

[5]  L. Stewart,et al.  To IPD or not to IPD? , 2002, Evaluation & the health professions.

[6]  Paula R Williamson,et al.  Aggregate data meta‐analysis with time‐to‐event outcomes , 2002, Statistics in medicine.

[7]  P. Grambsch,et al.  Penalized Survival Models and Frailty , 2003 .

[8]  F. Vaida,et al.  Proportional hazards model with random effects. , 2000, Statistics in medicine.

[9]  J. Ioannidis,et al.  Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias , 2008, PloS one.

[10]  M. Parmar,et al.  Bias in the Analysis and Reporting of Randomized Controlled Trials , 1996, International Journal of Technology Assessment in Health Care.

[11]  J. Kalbfleisch,et al.  The Statistical Analysis of Failure Time Data: Kalbfleisch/The Statistical , 2002 .

[12]  J P Pignon,et al.  Prophylactic cranial irradiation for patients with small-cell lung cancer in complete remission. Prophylactic Cranial Irradiation Overview Collaborative Group. , 1999, The New England journal of medicine.

[13]  Mark C Simmonds,et al.  Meta-analysis of individual patient data from randomized trials: a review of methods used in practice , 2005, Clinical trials.

[14]  J. Ioannidis Why Most Published Research Findings Are False , 2019, CHANCE.

[15]  R. Peto,et al.  Beta blockade during and after myocardial infarction: an overview of the randomized trials. , 1985, Progress in cardiovascular diseases.

[16]  R. Riley,et al.  Meta-analysis of individual participant data: rationale, conduct, and reporting , 2010, BMJ : British Medical Journal.

[17]  Jack Bowden,et al.  Quantifying, displaying and accounting for heterogeneity in the meta-analysis of RCTs using standard and generalised Q statistics , 2011, BMC medical research methodology.

[18]  M. Clarke Individual patient data meta-analyses. , 2005, Best practice & research. Clinical obstetrics & gynaecology.

[19]  R. Simes,et al.  Publication bias: evidence of delayed publication in a cohort study of clinical research projects , 1997, BMJ.

[20]  M. Parmar,et al.  Extracting summary statistics to perform meta-analyses of the published literature for survival endpoints. , 1998, Statistics in medicine.

[21]  J. Ioannidis Why Most Published Research Findings Are False , 2005, PLoS medicine.

[22]  Paula R Williamson,et al.  Investigating heterogeneity in an individual patient data meta‐analysis of time to event outcomes , 2005, Statistics in medicine.

[23]  S Greenland,et al.  Bias in the one-step method for pooling study results. , 1990, Statistics in medicine.

[24]  T. Yamaguchi,et al.  Investigating centre effects in a multi-centre clinical trial of superficial bladder cancer. , 1999, Statistics in medicine.

[25]  L. Stewart,et al.  Individual patient data meta-analysis in cancer. , 1998, British Journal of Cancer.

[26]  L. Stewart,et al.  Practical methodology of meta-analyses (overviews) using updated individual patient data. Cochrane Working Group. , 1995, Statistics in medicine.

[27]  G. Robinson That BLUP is a Good Thing: The Estimation of Random Effects , 1991 .

[28]  S. Burdett,et al.  Postoperative radiotherapy in non-small-cell lung cancer: systematic review and meta-analysis of individual patient data from nine randomised controlled trials , 1998, The Lancet.

[29]  M. Buyse,et al.  Efficacy of intravenous continuous infusion of fluorouracil compared with bolus administration in advanced colorectal cancer. , 1998, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[30]  T. Yamaguchi,et al.  Proportional hazards models with random effects to examine centre effects in multicentre cancer clinical trials , 2002, Statistical methods in medical research.

[31]  W. D. Ray 4. Modelling Survival Data in Medical Research , 1995 .

[32]  Sally Freels,et al.  Extracting summary statistics to perform meta‐analysis of the published literature for survival endpoints , 2004 .

[33]  David J Spiegelhalter,et al.  A re-evaluation of random-effects meta-analysis , 2009, Journal of the Royal Statistical Society. Series A,.

[34]  N. Laird,et al.  Meta-analysis in clinical trials. , 1986, Controlled clinical trials.

[35]  P. Mock,et al.  A comparison of two simple hazard ratio estimators based on the logrank test. , 1991, Statistics in medicine.

[36]  P Chomy,et al.  Prophylactic cranial irradiation for patients with small-cell lung cancer in complete remission. , 1995, Journal of the National Cancer Institute.

[37]  McGilchrist Ca REML estimation for survival models with frailty. , 1993 .

[38]  P. Williamson,et al.  A comparison of methods for fixed effects meta-analysis of individual patient data with time to event outcomes , 2007, Clinical trials.

[39]  J P Pignon,et al.  Random effects survival models gave a better understanding of heterogeneity in individual patient data meta-analyses. , 2005, Journal of clinical epidemiology.