Dealing with missing outcome data in randomized trials and observational studies.

Although missing outcome data are an important problem in randomized trials and observational studies, methods to address this issue can be difficult to apply. Using simulated data, the authors compared 3 methods to handle missing outcome data: 1) complete case analysis; 2) single imputation; and 3) multiple imputation (all 3 with and without covariate adjustment). Simulated scenarios focused on continuous or dichotomous missing outcome data from randomized trials or observational studies. When outcomes were missing at random, single and multiple imputations yielded unbiased estimates after covariate adjustment. Estimates obtained by complete case analysis with covariate adjustment were unbiased as well, with coverage close to 95%. When outcome data were missing not at random, all methods gave biased estimates, but handling missing outcome data by means of 1 of the 3 methods reduced bias compared with a complete case analysis without covariate adjustment. Complete case analysis with covariate adjustment and multiple imputation yield similar estimates in the event of missing outcome data, as long as the same predictors of missingness are included. Hence, complete case analysis with covariate adjustment can and should be used as the analysis of choice more often. Multiple imputation, in addition, can accommodate the missing-not-at-random scenario more flexibly, making it especially suited for sensitivity analyses.

[1]  M. Kenward,et al.  Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls , 2009, BMJ : British Medical Journal.

[2]  Michael G. Kenward,et al.  Missing data in randomised controlled trials: a practical guide , 2007 .

[3]  Theo Stijnen,et al.  Using the outcome for imputation of missing predictor values was preferred. , 2006, Journal of clinical epidemiology.

[4]  J. Pinheiro,et al.  Editorial: Dealing with the Missing Data Challenge in Clinical Trials , 2009 .

[5]  M. Davidian,et al.  Covariate adjustment for two‐sample treatment comparisons in randomized clinical trials: A principled yet flexible approach , 2008, Statistics in medicine.

[6]  Eric R. Ziegel,et al.  Statistical Issues in Drug Development , 1997 .

[7]  Ian R White,et al.  Imputation methods for missing outcome data in meta-analysis of clinical trials , 2008, Clinical trials.

[8]  Joseph L Schafer,et al.  Analysis of Incomplete Multivariate Data , 1997 .

[9]  Ian R White,et al.  Adjusting for partially missing baseline measurements in randomized trials , 2005, Statistics in medicine.

[10]  D. Rubin,et al.  Multiple Imputation for Nonresponse in Surveys , 1989 .

[11]  D. Altman,et al.  Missing data , 2007, BMJ : British Medical Journal.

[12]  D. Rubin.  Multiple imputation for nonresponse in surveys , 1989 .

[13]  Stef van Buuren,et al.  MICE: Multivariate Imputation by Chained Equations in R , 2011 .

[14]  J. Schafer,et al.  A comparison of inclusive and restrictive strategies in modern missing data procedures. , 2001, Psychological methods.

[15]  J. Schafer,et al.  Missing data: our view of the state of the art. , 2002, Psychological methods.

[16]  Laurence S Freedman,et al.  Simple adjustments for randomized trials with nonrandomly missing or censored outcomes arising from informative covariates. , 2005, Biostatistics.

[17]  Roderick J. A. Little.  Regression with Missing X's: A Review , 1992 .

[18]  Discussion: “Incomplete Data in Clinical Studies: Analysis, Sensitivity, and Sensitivity Analysis” by Geert Molenberghs , 2009 .

[19]  Geert Molenberghs,et al.  Incomplete Data in Clinical Studies: Analysis, Sensitivity, and Sensitivity Analysis , 2009 .

[20]  S Greenland,et al.  A critical look at methods for handling missing covariates in epidemiologic regression analyses. , 1995, American journal of epidemiology.

[21]  Yahong Peng,et al.  Recommendations for the Primary Analysis of Continuous Endpoints in Longitudinal Clinical Trials , 2008 .

[22]  Ian R White,et al.  Strategy for intention to treat analysis in randomised trials with missing outcome data , 2011, BMJ : British Medical Journal.

[23]  D. Rubin,et al.  Statistical Analysis with Missing Data. , 1989 .

[24]  D. Rubin,et al.  Statistical Analysis with Missing Data , 1988 .

[25]  Peter C Austin,et al.  Absolute risk reductions, relative risks, relative risk reductions, and numbers needed to treat can be obtained from a logistic regression model. , 2010, Journal of clinical epidemiology.

[26]  T. Stijnen,et al.  Review: a gentle introduction to imputation of missing values. , 2006, Journal of clinical epidemiology.

[27]  J. Lewis,et al.  Statistical principles for clinical trials (ICH E9): an introductory note on an international guideline. , 1999, Statistics in medicine.

[28]  A. Hoes,et al.  Reporting of treatment effects from randomized trials: a plea for multivariable risk ratios. , 2011, Contemporary clinical trials.

[29]  Roderick J. A. Little,et al.  Statistical Analysis with Missing Data: Little/Statistical Analysis with Missing Data , 2002 .

[30]  M. Gail,et al.  Biased estimates of treatment effect in randomized experiments with nonlinear regressions and omitted covariates , 1984 .

[31]  Geert Molenberghs,et al.  Analyzing incomplete longitudinal clinical trial data. , 2004, Biostatistics.

[32]  Douglas G Altman,et al.  Missing outcomes in randomized trials: addressing the dilemma , 2009, Open medicine : a peer-reviewed, independent, open-access journal.

[33]  Stephen Senn,et al.  Statistical Issues in Drug Development , 1997 .

[34]  Werner Vach,et al.  Logistic Regression with Missing Values in the Covariates , 1994 .

[35]  S. Pocock,et al.  Subgroup analysis, covariate adjustment and baseline comparisons in clinical trial reporting: current practiceand problems , 2002, Statistics in medicine.