When and how should multiple imputation be used for handling missing data in randomised clinical trials – a practical guide with flowcharts

BackgroundMissing data may seriously compromise inferences from randomised clinical trials, especially if missing data are not handled appropriately. The potential bias due to missing data depends on the mechanism causing the data to be missing, and the analytical methods applied to amend the missingness. Therefore, the analysis of trial data with missing values requires careful planning and attention.MethodsThe authors had several meetings and discussions considering optimal ways of handling missing data to minimise the bias potential. We also searched PubMed (key words: missing data; randomi*; statistical analysis) and reference lists of known studies for papers (theoretical papers; empirical studies; simulation studies; etc.) on how to deal with missing data when analysing randomised clinical trials.ResultsHandling missing data is an important, yet difficult and complex task when analysing results of randomised clinical trials. We consider how to optimise the handling of missing data during the planning stage of a randomised clinical trial and recommend analytical approaches which may prevent bias caused by unavoidable missing data. We consider the strengths and limitations of using of best-worst and worst-best sensitivity analyses, multiple imputation, and full information maximum likelihood. We also present practical flowcharts on how to deal with missing data and an overview of the steps that always need to be considered during the analysis stage of a trial.ConclusionsWe present a practical guide and flowcharts describing when and how multiple imputation should be used to handle missing data in randomised clinical.

[1]  J. Higgins,et al.  Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0. The Cochrane Collaboration , 2013 .

[2]  Jon Brumbaugh,et al.  DEPARTMENT OF HEALTH AND HUMAN SERVICES FOOD AND DRUG ADMINISTRATION , 2000 .

[3]  Anika Ashok,et al.  Guidance for Industry by U.S. Department of Health and Human Services—Food and Drug Administration—Center for Biologics Evaluation and Research (CBER)—February 1999 , 2009 .

[4]  Douglas G Altman,et al.  Developing a prognostic model in the presence of missing data: an ovarian cancer case study. , 2003, Journal of clinical epidemiology.

[5]  J. Tenhunen,et al.  Hydroxyethyl starch 130/0.42 versus Ringer's acetate in severe sepsis. , 2012, The New England journal of medicine.

[6]  Melanie L Bell,et al.  Handling missing data in RCTs; a review of the top medical journals , 2014, BMC Medical Research Methodology.

[7]  Paul Landais,et al.  Simple randomization did not protect against bias in smaller trials. , 2017, Journal of clinical epidemiology.

[8]  Isabelle Boutron,et al.  Observer bias in randomised clinical trials with binary outcomes: systematic review of trials with both blinded and non-blinded outcome assessors , 2012, BMJ : British Medical Journal.

[9]  L. Kux OF HEALTH AND HUMAN SERVICES Food and Drug Administration , 2014 .

[10]  J. Hilden,et al.  Observer bias in randomized clinical trials with measurement scale outcomes: a systematic review of trials with both blinded and nonblinded assessors , 2013, Canadian Medical Association Journal.

[11]  “ Multiple Imputation in Practice : Comparison of Software Packages for Regression Models With Missing Variables , ” , 2002 .

[12]  Lara A Kahale,et al.  A systematic survey of the methods literature on the reporting quality and optimal methods of handling participants with missing outcome data for continuous outcomes in randomized controlled trials. , 2017, Journal of clinical epidemiology.

[13]  Alireza Atri,et al.  An Overview of Longitudinal Data Analysis Methods for Neurological Research , 2011, Dementia and Geriatric Cognitive Disorders Extra.

[14]  Kristian Thorlund,et al.  Reanalyses of randomized clinical trial data. , 2014, JAMA.

[15]  Jørn Wetterslev,et al.  Comparison of Results from Different Imputation Techniques for Missing Data from an Anti-Obesity Drug Trial , 2014, PloS one.

[16]  Ann Sofia Skou Thomsen,et al.  Bias due to lack of patient blinding in clinical trials. A systematic review of trials randomizing patients to blind and nonblind sub-studies. , 2014, International journal of epidemiology.

[17]  Geert Molenberghs,et al.  Doubly Robust and Multiple-Imputation-Based Generalized Estimating Equations , 2011, Journal of biopharmaceutical statistics.

[18]  J. Jakobsen,et al.  Thresholds for statistical and clinical significance in systematic reviews with meta-analytic methods , 2014, BMC Medical Research Methodology.

[19]  B. Kahan Accounting for centre-effects in multicentre trials with a binary outcome – when, why, and how? , 2014, BMC Medical Research Methodology.

[20]  Sergio Sismondo,et al.  Industry sponsorship and research outcome. , 2012, The Cochrane database of systematic reviews.

[21]  Tim P Morris,et al.  Choosing sensitivity analyses for randomised trials: principles , 2014, BMC Medical Research Methodology.

[22]  J. Jakobsen,et al.  The thresholds for statistical and clinical significance – a five-step procedure for evaluation of intervention effects in randomised clinical trials , 2014, BMC Medical Research Methodology.

[23]  Tianjing Li,et al.  Multiple outcomes and analyses in clinical trials create challenges for interpretation and research synthesis. , 2017, Journal of clinical epidemiology.

[24]  M. Kenward,et al.  Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls , 2009, BMJ : British Medical Journal.

[25]  R. Little,et al.  The prevention and treatment of missing data in clinical trials. , 2012, The New England journal of medicine.

[26]  B. Kahan,et al.  Reporting and analysis of trials using stratified randomisation in leading medical journals: review and reanalysis , 2012, BMJ : British Medical Journal.

[27]  B. Kahan,et al.  Improper analysis of trials randomised using stratified blocks or minimisation , 2012, Statistics in medicine.

[28]  Karel G M Moons,et al.  Randomized trials with missing outcome data: how to analyze and what to report , 2014, Canadian Medical Association Journal.

[29]  Lorenzo Bertizzolo,et al.  Cherry-picking by trialists and meta-analysts can drive conclusions about intervention efficacy. , 2017, Journal of clinical epidemiology.

[30]  Lori A. Post,et al.  Strategies for Dealing with Missing Data in Clinical Trials: From Design to Analysis , 2013, The Yale journal of biology and medicine.