Missing Data: Turning Guidance Into Action

Recent research has fostered new guidance on preventing and treating missing data. This article is the consensus opinion of the Drug Information Association's Scientific Working Group on Missing Data. Common elements from recent guidance are distilled and means for putting the guidance into action are proposed. The primary goal is to maximize the proportion of patients that adhere to the protocol specified interventions. In so doing, trial design and trial conduct should be considered. Completion rate should be focused upon as much as enrollment rate, with particular focus on minimizing loss to follow-up. Whether or not follow-up data after discontinuation of the originally randomized medication and/or initiation of rescue medication contribute to the primary estimand depends on the context. In outcomes trials (intervention thought to influence disease process) follow-up data are often included in the primary estimand, whereas in symptomatic trials (intervention alters symptom severity but does not change underlying disease) follow-up data are often not included. Regardless of scenario, the confounding influence of rescue medications can render follow-up data of little use in understanding the causal effects of the randomized interventions. A sensible primary analysis can often be formulated in the missing at random (MAR) framework. Sensitivity analyses assessing robustness to departures from MAR are crucial. Plausible sensitivity analyses can be prespecified using controlled imputation approaches to either implement a plausibly conservative analysis or to stress test the primary result, and used in combination with other model-based MNAR approaches such as selection, shared parameter, and pattern-mixture models. The example dataset and analyses used in this article are freely available for public use at www.missingdata.org.uk.

[1]  London School of Hygiene and Tropical Medicine , 1938, Nature.

[2]  D. Rubin,et al.  Multiple Imputation for Nonresponse in Surveys , 1989 .

[3]  C H Mallinckrodt,et al.  A structured approach to choosing estimands and estimators in longitudinal clinical trials , 2012, Pharmaceutical statistics.

[4]  D. J. Goldstein,et al.  Duloxetine in the treatment of depression: A double-blind placebo-controlled comparison with paroxetine , 2002, European Neuropsychopharmacology.

[5]  M. Kenward,et al.  A comparison of multiple imputation and doubly robust estimation for analyses with missing data , 2006 .

[6]  M. Hamilton A RATING SCALE FOR DEPRESSION , 1960, Journal of neurology, neurosurgery, and psychiatry.

[7]  Roderick J. A. Little,et al.  Statistical Analysis with Missing Data: Little/Statistical Analysis with Missing Data , 2002 .

[8]  Yongman Kim Missing Data Handling in Chronic Pain Trials , 2011, Journal of biopharmaceutical statistics.

[9]  M. Detke,et al.  The efficacy of duloxetine: A comprehensive summary of results from MMRM and LOCF_ANCOVA in eight clinical trials , 2004, BMC psychiatry.

[10]  Geert Molenberghs,et al.  Linear Mixed Models , 2011, International Encyclopedia of Statistical Science.

[11]  Yahong Peng,et al.  Recommendations for the Primary Analysis of Continuous Endpoints in Longitudinal Clinical Trials , 2008 .

[12]  B. Ratitch,et al.  Implementation of Pattern-Mixture Models Using Standard SAS/STAT Procedures , 2011 .

[13]  J. Robins,et al.  Estimation of Regression Coefficients When Some Regressors are not Always Observed , 1994 .

[14]  J. Robins,et al.  Analysis of semiparametric regression models for repeated outcomes in the presence of missing data , 1995 .

[15]  John Fox,et al.  Linear Mixed Models , 1999 .

[16]  J. Coyne,et al.  Are Treatment Preferences Relevant in Response to Serotonergic Antidepressants and Cognitive-Behavioral Therapy in Depressed Primary Care Patients? Results from a Randomized Controlled Trial Including a Patients’ Choice Arm , 2010, Psychotherapy and Psychosomatics.

[17]  Ana Ivelisse Avilés,et al.  Linear Mixed Models for Longitudinal Data , 2001, Technometrics.

[18]  W. Brown,et al.  Psychiatric Diagnosis and Clinical Trial Completion Rates: Analysis of the FDA SBA Reports , 2007, Neuropsychopharmacology.

[19]  A. Tsiatis Semiparametric Theory and Missing Data , 2006 .

[20]  Geert Molenberghs,et al.  Analyzing incomplete longitudinal clinical trial data. , 2004, Biostatistics.

[21]  Michael G. Kenward,et al.  Conceptual Considerations regarding Endpoints, Hypotheses, and Analyses for Incomplete Longitudinal Clinical Trial Data , 2009 .

[22]  Michael G. Kenward,et al.  A method for increasing the robustness of multiple imputation , 2012, Comput. Stat. Data Anal..

[23]  R Little,et al.  Intent-to-treat analysis for longitudinal studies with drop-outs. , 1996, Biometrics.

[24]  D. Rubin,et al.  Statistical Analysis with Missing Data. , 1989 .

[25]  J. Pinheiro,et al.  Editorial: Dealing with the Missing Data Challenge in Clinical Trials , 2009 .

[26]  R T O'Neill,et al.  The Prevention and Treatment of Missing Data in Clinical Trials: An FDA Perspective on the Importance of Dealing With It , 2012, Clinical pharmacology and therapeutics.

[27]  Robert O'Neill,et al.  MMRM vs. LOCF: A Comprehensive Comparison Based on Simulation Study and 25 NDA Datasets , 2009, Journal of biopharmaceutical statistics.

[28]  P. Lane Handling drop‐out in longitudinal clinical trials: a comparison of the LOCF and MMRM approaches , 2008, Pharmaceutical statistics.

[29]  L. Hunt,et al.  Missing Data in Clinical Studies , 2007 .

[30]  Michael G. Kenward,et al.  Missing data in randomised controlled trials: a practical guide , 2007 .

[31]  C. Soares,et al.  Assessing the relationship between functional impairment/recovery and depression severity: a pooled analysis , 2012, International clinical psychopharmacology.