Meta-analysis of individual patient data versus aggregate data from longitudinal clinical trials

Background In clinical trials following individuals over a period of time, the same assessment may be made at a number of time points during the course of the trial. Our review of current practice for handling longitudinal data in Cochrane systematic reviews shows that the most frequently used approach is to ignore the correlation between repeated observations and to conduct separate meta-analyses at each of a number of time points. Purpose The purpose of this paper is to show the link between repeated measurement models used with aggregate data and those used when individual patient data (IPD) are available, and provide guidance on the methods that practitioners might use for aggregate data meta-analyses, depending on the type of data available. Methods We discuss models for the meta-analysis of longitudinal continuous outcome data when IPD are available. In these models time is included either as a factor or as a continuous variable, and account is taken of the correlation between repeated observations. The meta-analysis of IPD can be conducted using either a one-step or a two-step approach: the latter involves analysing the IPD separately in each study and then combining the study estimates taking into account their covariance structure. We discuss the link between models for use with aggregate data and the two-step IPD approach, and the problems which arise when only aggregate data are available. The methods are applied to IPD from 5 trials in Alzheimer's disease. Results Two major issues for the meta-analysis of aggregate data are the lack of information about correlation coefficients and the effect of missing data at the patient-level. Application to the Alzheimer's disease data set shows that ignoring correlation can lead to different pooled estimates of the treatment difference and their standard errors. Furthermore, the amount of missing data at the patient level can affect these estimates. Limitations The models assume fixed treatment effects across studies, and that any missing data is missing at random, both at the patient-level and the study level. Conclusions It is preferable to obtain IPD from all studies to correctly account for the correlation between repeated observations. When IPD are not available, the ideal aggregate data are model-based estimates of treatment difference and their variance and covariance estimates. If covariance estimates are not available, sensitivity analyses should be undertaken to investigate the robustness of the results to different amounts of correlation. Clinical Trials 2009; 6: 16—27. http:// ctj.sagepub.com

[1]  Mark C Simmonds,et al.  Meta-analysis of individual patient data from randomized trials: a review of methods used in practice , 2005, Clinical trials.

[2]  H. Goldstein,et al.  Meta‐analysis using multilevel models with an application to the study of class size effects , 2000 .

[3]  Richard D Riley,et al.  Beyond the Bench: Hunting Down Fugitive Literature , 2004, Environmental Health Perspectives.

[4]  P C Lambert,et al.  An evaluation of bivariate random‐effects meta‐analysis for the joint synthesis of two correlated outcomes , 2007, Statistics in medicine.

[5]  P. Diggle,et al.  Analysis of Longitudinal Data , 2003 .

[6]  Richard D Riley,et al.  Evidence synthesis combining individual patient data and aggregate data: a systematic review identified current practice and possible methods. , 2007, Journal of clinical epidemiology.

[7]  P. Müller,et al.  Bayesian Meta‐analysis for Longitudinal Data Models Using Multivariate Mixture Priors , 2003, Biometrics.

[8]  F Mosteller,et al.  Meta-analysis of multiple outcomes by regression with random effects. , 1998, Statistics in medicine.

[9]  F. E. Satterthwaite Synthesis of variance , 1941 .

[10]  Lawrence Joseph,et al.  Impact of approximating or ignoring within‐study covariances in multivariate meta‐analyses , 2008, Statistics in medicine.

[11]  A Whitehead,et al.  The effect of selegiline in the treatment of people with Alzheimer's disease: a meta‐analysis of published trials , 2002, International journal of geriatric psychiatry.

[12]  H. I. Patel Analysis of incomplete data from a clinical trial with repeated measurements , 1991 .

[13]  M. Kenward,et al.  Small sample inference for fixed effects from restricted maximum likelihood. , 1997, Biometrics.

[14]  R. Wolfinger Covariance structure selection in general mixed models , 1993 .

[15]  Cindy Farquhar,et al.  3 The Cochrane Library , 1996 .

[16]  Theo Stijnen,et al.  Advanced methods in meta‐analysis: multivariate approach and meta‐regression , 2002, Statistics in medicine.

[17]  C S Berkey,et al.  Multiple-outcome meta-analysis of clinical trials. , 1996, Statistics in medicine.

[18]  P. Williamson,et al.  Bias in meta‐analysis due to outcome variable selection within studies , 2000 .

[19]  R C Littell,et al.  Mixed Models: Modelling Covariance Structure in the Analysis of Repeated Measures Data , 2005 .

[20]  C D Naylor,et al.  Meta-analysis of controlled clinical trials. , 1989, The Journal of rheumatology.

[21]  Richard D Riley,et al.  Meta‐analysis of continuous outcomes combining individual patient data and aggregate data , 2008, Statistics in medicine.

[22]  K Jack Ishak,et al.  Meta-analysis of longitudinal studies , 2007, Clinical trials.

[23]  K. Dear,et al.  Iterative generalized least squares for meta-analysis of survival data at multiple times. , 1994, Biometrics.

[24]  Dorothy D. Dunlop,et al.  Regression for Longitudinal Data: A Bridge from Least Squares Regression , 1994 .

[25]  Kerrie Mengersen,et al.  Multivariate meta‐analysis , 2003, Statistics in medicine.