Meta‐analysis of aggregate data on medical events

Meta‐analyses of clinical trials often treat the number of patients experiencing a medical event as binomially distributed when individual patient data for fitting standard time‐to‐event models are unavailable. Assuming identical drop‐out time distributions across arms, random censorship, and low proportions of patients with an event, a binomial approach results in a valid test of the null hypothesis of no treatment effect with minimal loss in efficiency compared with time‐to‐event methods. To deal with differences in follow‐up—at the cost of assuming specific distributions for event and drop‐out times—we propose a hierarchical multivariate meta‐analysis model using the aggregate data likelihood based on the number of cases, fatal cases, and discontinuations in each group, as well as the planned trial duration and groups sizes. Such a model also enables exchangeability assumptions about parameters of survival distributions, for which they are more appropriate than for the expected proportion of patients with an event across trials of substantially different length. Borrowing information from other trials within a meta‐analysis or from historical data is particularly useful for rare events data. Prior information or exchangeability assumptions also avoid the parameter identifiability problems that arise when using more flexible event and drop‐out time distributions than the exponential one. We discuss the derivation of robust historical priors and illustrate the discussed methods using an example. We also compare the proposed approach against other aggregate data meta‐analysis methods in a simulation study. Copyright © 2016 John Wiley & Sons, Ltd.

[1]  Karl Pearson,et al.  Mathematical contributions to the theory of evolution, On the law of ancestral heredity , 1898, Proceedings of the Royal Society of London.

[2]  G. Yule NOTES ON THE THEORY OF ASSOCIATION OF ATTRIBUTES IN STATISTICS , 1903 .

[3]  E. H. Simpson,et al.  The Interpretation of Interaction in Contingency Tables , 1951 .

[4]  David R. Cox,et al.  Regression models and life tables (with discussion , 1972 .

[5]  S J Pocock,et al.  The combination of randomized and historical controls in clinical trials. , 1976, Journal of chronic diseases.

[6]  G. Glass Primary, Secondary, and Meta-Analysis of Research1 , 1976 .

[7]  M. Gail,et al.  Biased estimates of treatment effect in randomized experiments with nonlinear regressions and omitted covariates , 1984 .

[8]  Tony Lancaster,et al.  Generalised residuals and heterogeneous duration models: With applications to the Weilbull model , 1985 .

[9]  J M Lachin,et al.  Evaluation of sample size and power for analyses of survival with allowance for nonuniform patient entry, losses to follow-up, noncompliance, and stratification. , 1986, Biometrics.

[10]  L. Ryan,et al.  Issues of efficiency in combining proportions of deaths from several clinical trials. , 1987, Statistics in medicine.

[11]  M. S. Patel,et al.  An introduction to meta-analysis. , 1989, Health Policy.

[12]  D J Greenblatt,et al.  Pharmacokinetics and pharmacodynamics. , 1990, Hospital practice.

[13]  A Whitehead,et al.  A general parametric approach to the meta-analysis of randomized clinical trials. , 1991, Statistics in medicine.

[14]  Luis A. Escobar,et al.  Statistical Intervals: A Guide for Practitioners , 1991 .

[15]  N. Jewell,et al.  A geometric approach to assess bias due to omitted covariates in generalized linear models , 1993 .

[16]  StatisticsHarvard,et al.  Avoiding model selection in Bayesian social research , 1994 .

[17]  Nitin R. Patel,et al.  Exact logistic regression: theory and examples. , 1995, Statistics in medicine.

[18]  Paul D. Allison,et al.  Survival analysis using sas®: a practical guide , 1995 .

[19]  D J Spiegelhalter,et al.  Bayesian approaches to random-effects meta-analysis: a comparative study. , 1995, Statistics in medicine.

[20]  A Whitehead,et al.  Borrowing strength from external trials in a meta-analysis. , 1996, Statistics in medicine.

[21]  N. Black CONSORT , 1996, The Lancet.

[22]  M. Parmar,et al.  Extracting summary statistics to perform meta-analyses of the published literature for survival endpoints. , 1998, Statistics in medicine.

[23]  N Breslow,et al.  Generalized linear mixed models for meta-analysis. , 1999, Statistics in medicine.

[24]  A. Gelfand,et al.  Identifiability, Improper Priors, and Gibbs Sampling for Generalized Linear Models , 1999 .

[25]  John M. Lachin,et al.  Biostatistical Methods: The Assessment of Relative Risks , 2000 .

[26]  A. Agresti,et al.  Strategies for comparing treatments on a binary response with multi-centre data. , 2000, Statistics in medicine.

[27]  S Greenland,et al.  Small-sample bias and corrections for conditional maximum-likelihood odds-ratio estimators. , 2000, Biostatistics.

[28]  C. Veyrat‐Follet,et al.  Clinical trial simulation of docetaxel in patients with cancer as a tool for dosage optimization , 2000, Clinical pharmacology and therapeutics.

[29]  M Schemper,et al.  A Solution to the Problem of Monotone Likelihood in Cox Regression , 2001, Biometrics.

[30]  Paula R Williamson,et al.  Aggregate data meta‐analysis with time‐to‐event outcomes , 2002, Statistics in medicine.

[31]  M. Schemper,et al.  A solution to the problem of separation in logistic regression , 2002, Statistics in medicine.

[32]  M. Symons,et al.  Hazard rate ratio and prospective epidemiological studies. , 2002, Journal of clinical epidemiology.

[33]  M. May Bayesian Survival Analysis. , 2002 .

[34]  Nicola J Cooper,et al.  Meta-analysis of rare and adverse event data , 2002, Expert review of pharmacoeconomics & outcomes research.

[35]  Antonio Lijoi,et al.  Approximating priors by finite mixtures of conjugate distributions for an exponential family , 2003 .

[36]  J. Ibrahim,et al.  Conjugate priors for generalized linear models , 2003 .

[37]  William J. Browne,et al.  Bayesian and likelihood-based methods in multilevel modeling 1 A comparison of Bayesian and likelihood-based methods for fitting multilevel models , 2006 .

[38]  Karim F. Hirji,et al.  Exact Analysis of Discrete Data , 2005 .

[39]  Gary H Lyman,et al.  The strengths and limitations of meta-analyses based on aggregate data , 2005, BMC Medical Research Methodology.

[40]  David R. Jones,et al.  How vague is vague? A simulation study of the impact of the use of vague prior distributions in MCMC using WinBUGS , 2005, Statistics in medicine.

[41]  J. Davis Univariate Discrete Distributions , 2006 .

[42]  Kenneth Liu,et al.  Confidence intervals for an exposure adjusted incidence rate difference with applications to clinical trials , 2006, Statistics in medicine.

[43]  Joel B Greenhouse,et al.  Do antidepressants cause suicidality in children? A Bayesian meta-analysis , 2006, Clinical trials.

[44]  C. Adams,et al.  The Leeds Evaluation of Efficacy of Detoxification Study (LEEDS) prisons project pilot study: protocol for a randomised controlled trial comparing dihydrocodeine and buprenorphine for opiate detoxification , 2007, Trials.

[45]  S. Nissen,et al.  Effect of rosiglitazone on the risk of myocardial infarction and death from cardiovascular causes. , 2007, The New England journal of medicine.

[46]  Stephen Senn,et al.  (www.interscience.wiley.com) DOI: 10.1002/sim.2639 Trying to be precise about vagueness , 2022 .

[47]  M. Sydes,et al.  Practical methods for incorporating summary time-to-event data into meta-analysis , 2007, Trials.

[48]  Christian P. Robert,et al.  The Bayesian choice : from decision-theoretic foundations to computational implementation , 2007 .

[49]  Jonathan J Deeks,et al.  Much ado about nothing: a comparison of the performance of meta‐analytical methods with rare events , 2007, Statistics in medicine.

[50]  M. G. Pittau,et al.  A weakly informative default prior distribution for logistic and other regression models , 2008, 0901.4011.

[51]  S. Senn Lessons from TGN1412 and TARGET: implications for observational studies and meta‐analysis , 2008, Pharmaceutical statistics.

[52]  Alan Agresti,et al.  A Step-by-Step Approach to Using SAS for Univariate & Multivariate Statistics, 2nd Edition + An Introduction to Categorical Data Analysis, 2nd Edition , 2008 .

[53]  Richard D Riley,et al.  Meta‐analysis of continuous outcomes combining individual patient data and aggregate data , 2008, Statistics in medicine.

[54]  Norman E. Fenton,et al.  Modelling dependable systems using hybrid Bayesian networks , 2008, Reliab. Eng. Syst. Saf..

[55]  Theo Stijnen,et al.  Meta‐analysis of summary survival curve data , 2008, Statistics in medicine.

[56]  P. Bagos,et al.  Mixed-Effects Poisson Regression Models for Meta-Analysis of Follow-Up Studies with Constant or Varying Durations , 2009 .

[57]  H. Wunsch,et al.  Use of intensive care services during terminal hospitalizations in England and the United States. , 2009, American journal of respiratory and critical care medicine.

[58]  M. Coory,et al.  Bayesian versus frequentist statistical inference for investigating a one-off cancer cluster reported to a health department , 2009, BMC medical research methodology.

[59]  James G. Scott,et al.  Handling Sparsity via the Horseshoe , 2009, AISTATS.

[60]  Theo Stijnen,et al.  Random effects meta‐analysis of event outcome in the framework of the generalized linear mixed model with applications in sparse data , 2010, Statistics in medicine.

[61]  Richard D Riley,et al.  Meta‐analysis of a binary outcome using individual participant data and aggregate data , 2010, Research synthesis methods.

[62]  Tianxi Cai,et al.  Meta‐analysis for rare events , 2010, Statistics in medicine.

[63]  A. Ismaila,et al.  A tutorial on pilot studies: the what, why and how , 2010, BMC Medical Research Methodology.

[64]  D. Moher,et al.  CONSORT 2010 Statement: updated guidelines for reporting parallel group randomized trials , 2010, Obstetrics and gynecology.

[65]  Neil Hawkins,et al.  Network meta-analysis on the log-hazard scale, combining count and hazard ratio statistics accounting for multi-arm trials: A tutorial , 2010, BMC medical research methodology.

[66]  Bradley P Carlin,et al.  Hierarchical Commensurate and Power Prior Models for Adaptive Incorporation of Historical Information in Clinical Trials , 2011, Biometrics.

[67]  Nicky J Welton,et al.  NICE DSU Technical Support Document 2: A Generalised Linear Modelling Framework for Pairwise and Network Meta-Analysis of Randomised Controlled Trials , 2011 .

[68]  Rebecca M Turner,et al.  Characteristics of meta-analyses and their component studies in the Cochrane Database of Systematic Reviews: a cross-sectional, descriptive analysis , 2011, BMC medical research methodology.

[69]  C. McCulloch,et al.  Misspecifying the Shape of a Random Effects Distribution: Why Getting It Wrong May Not Matter , 2011, 1201.1980.

[70]  J. Higgins Cochrane handbook for systematic reviews of interventions. Version 5.1.0 [updated March 2011]. The Cochrane Collaboration , 2011 .

[71]  W. Henley,et al.  Improved curve fits to summary survival data: application to economic evaluation of health technologies , 2011, BMC Medical Research Methodology.

[72]  R. Rosenheck,et al.  Joint modelling of longitudinal outcome and interval‐censored competing risk dropout in a schizophrenia clinical trial , 2012, Journal of the Royal Statistical Society. Series A,.

[73]  Joseph G Ibrahim,et al.  Bayesian Meta‐Experimental Design: Evaluating Cardiovascular Risk in New Antidiabetic Therapies to Treat Type 2 Diabetes , 2012, Biometrics.

[74]  Richard D Riley,et al.  Individual patient data meta-analysis of survival data using Poisson regression models , 2012, BMC Medical Research Methodology.

[75]  Jean-Michel Marin,et al.  Approximate Bayesian computational methods , 2011, Statistics and Computing.

[76]  S. Golder,et al.  Systematic review of methods used in meta-analyses where a primary outcome is an adverse or unintended event , 2012, BMC Medical Research Methodology.

[77]  Gagandeep Kang,et al.  Analysis of human immune responses in quasi-experimental settings: tutorial in biostatistics , 2012, BMC Medical Research Methodology.

[78]  Hans-Peter Piepho,et al.  The Use of Two‐Way Linear Mixed Models in Multitreatment Meta‐Analysis , 2012, Biometrics.

[79]  Adrian E. Raftery,et al.  mclust Version 4 for R : Normal Mixture Modeling for Model-Based Clustering , Classification , and Density Estimation , 2012 .

[80]  Nicky J Welton,et al.  Enhanced secondary analysis of survival data: reconstructing the data from published Kaplan-Meier survival curves , 2012, BMC Medical Research Methodology.

[81]  Rafael Perera,et al.  New treatments compared to established treatments in randomized trials ( Review ) , 2022 .

[82]  Peter W Lane,et al.  Meta-analysis of incidence of rare events , 2013, Statistical methods in medical research.

[83]  Richard F MacLehose,et al.  Sensitivity Analyses for Sparse-Data Problems—Using Weakly Informative Bayesian Priors , 2013, Epidemiology.

[84]  Evangelos Kontopantelis,et al.  A Re-Analysis of the Cochrane Library Data: The Dangers of Unobserved Heterogeneity in Meta-Analyses , 2013, PloS one.

[85]  Sophia Rabe-Hesketh,et al.  Avoiding zero between‐study variance estimates in random‐effects meta‐analysis , 2013, Statistics in medicine.

[86]  John W Seaman,et al.  Comparison of Bayesian and Frequentist Meta-Analytical Approaches for Analyzing Time to Event Data , 2013, Journal of biopharmaceutical statistics.

[87]  M. Betancourt,et al.  Hamiltonian Monte Carlo for Hierarchical Models , 2013, 1312.0906.

[88]  Alex J Sutton,et al.  Hierarchical network meta‐analysis models to address sparsity of events and differing treatment classifications with regard to adverse outcomes , 2014, Statistics in medicine.

[89]  K. Lee,et al.  Korean translation of the CONSORT 2010 Statement: updated guidelines for reporting parallel group randomized trials , 2014, Epidemiology and health.

[90]  Anthony O'Hagan,et al.  Robust meta‐analytic‐predictive priors in clinical trials with historical control information , 2014, Biometrics.

[91]  Andrew Gelman,et al.  The No-U-turn sampler: adaptively setting path lengths in Hamiltonian Monte Carlo , 2011, J. Mach. Learn. Res..

[92]  S. Normand,et al.  Meta‐analysis of rate ratios with differential follow‐up by treatment arm: inferring comparative effectiveness of medical devices , 2015, Statistics in medicine.

[93]  D Zeng,et al.  Equity-specific effects of interventions to promote physical activity among middle-aged and older adults: results from applying a novel equity-specific re-analysis strategy , 2021, International Journal of Behavioral Nutrition and Physical Activity.

[94]  D. Kault,et al.  From P-Values to Objective Probabilities in Assessing Medical Treatments , 2015, PloS one.

[95]  Patrick Royston,et al.  Meta‐analysis of time‐to‐event outcomes from randomized trials using restricted mean survival time: application to individual participant data , 2015, Statistics in medicine.

[96]  Kalliopi Mylona,et al.  Meta‐analysis of clinical trials with rare events , 2015, Biometrical journal. Biometrische Zeitschrift.

[97]  Joseph G Ibrahim,et al.  The power prior: theory and applications , 2015, Statistics in medicine.

[98]  O Kuss,et al.  Statistical methods for meta‐analyses including information from studies without any events—add nothing to nothing and succeed nevertheless , 2015, Statistics in medicine.

[99]  Nicholas G. Polson,et al.  Default Bayesian Analysis with Global-Local Shrinkage Priors , 2015, 1510.03516.

[100]  M. Fischereder,et al.  Empagliflozin, Cardiovascular Outcomes, and Mortality in Type 2 Diabetes. , 2016, The New England journal of medicine.

[101]  Qi Jiang,et al.  Statistical Monitoring of Safety in Clinical Trials , 2016 .

[102]  Heinz Schmidli,et al.  On the Use of Co-Data in Clinical Trials , 2016 .

[103]  R. Bender,et al.  Performance of the Peto odds ratio compared to the usual odds ratio estimator in the case of rare events , 2016, Biometrical journal. Biometrische Zeitschrift.

[104]  Bayesian Estimation and Testing in Random Effects Meta-Analysis of Rare Binary Adverse Events , 2016, Statistics in biopharmaceutical research.

[105]  Control charts for monitoring accumulating adverse event count frequencies from single and multiple blinded trials , 2016, Statistics in medicine.

[106]  John A Scott,et al.  Addressing prior-data conflict with empirical meta-analytic-predictive priors in clinical studies with historical information , 2016, Journal of biopharmaceutical statistics.

[107]  David Ohlssen,et al.  Strategies on Using Prior Information When Assessing Adverse Events , 2016 .

[108]  C Combescure,et al.  Meta-analysis of two-arm studies: Modeling the intervention effect from survival probabilities , 2016, Statistical methods in medical research.

[109]  Satrajit Roychoudhury,et al.  Robust exchangeability designs for early phase clinical trials with multiple strata , 2016, Pharmaceutical statistics.

[110]  Admin Wiley,et al.  Dataset for: Meta-analysis of aggregate data on medical events , 2017 .

[111]  Tim Friede,et al.  Meta‐analysis of few small studies in orphan diseases , 2016, Research synthesis methods.

[112]  N. Wald,et al.  Sharing Clinical Trial Data , 2017, Journal of medical screening.

[113]  Jiqiang Guo,et al.  Stan: A Probabilistic Programming Language. , 2017, Journal of statistical software.

[114]  Richard D. Riley,et al.  Random effects meta‐analysis: Coverage performance of 95% confidence and prediction intervals following REML estimation , 2016, Statistics in medicine.

[115]  Sean Khozin,et al.  Advantages of a Truly Open-Access Data-Sharing Model. , 2017, The New England journal of medicine.

[116]  Clemens Elster,et al.  Bayesian estimation in random effects meta‐analysis using a non‐informative prior , 2017, Statistics in medicine.