Imputation methods for missing outcome data in meta-analysis of clinical trials

Background: Missing outcome data from randomized trials lead to greater uncertainty and possible bias in estimating the effect of an experimental treatment. An intention-to-treat analysis should take account of all randomized participants even if they have missing observations. Purpose: To review and develop imputation methods for missing outcome data in meta-analysis of clinical trials with binary outcomes. Methods: We review some common strategies, such as simple imputation of positive or negative outcomes, and develop a general approach involving `informative missingness odds ratios' (IMORs). We describe several choices for weighting studies in the meta-analysis, and illustrate methods using a meta-analysis of trials of haloperidol for schizophrenia. Results: IMORs describe the relationship between the unknown risk among missing participants and the known risk among observed participants. They are allowed to differ between treatment groups and across trials. Application of IMORs and other methods to the haloperidol trials reveals the overall conclusion to be robust to different assumptions about the missing data. Limitations: The methods are based on summary data from each trial (number of observed positive outcomes, number of observed negative outcomes and number of missing outcomes) for each intervention group. This limits the options for analysis, and greater flexibility would be available with individual participant data. Conclusions: We propose that available reasons for missingness be used to determine appropriate IMORs. We also recommend a strategy for undertaking sensitivity analyses, in which the IMORs are varied over plausible ranges. Clinical Trials 2008; 5: 225—239. http://ctj.sagepub.com

[1]  Ian R White,et al.  Allowing for uncertainty due to missing data in meta‐analysis—Part 1: Two‐stage methods , 2008, Statistics in medicine.

[2]  Carrol Gamble,et al.  Uncertainty method improved on best-worst case analysis in a binary meta-analysis. , 2005, Journal of clinical epidemiology.

[3]  Ian R White,et al.  Are missing outcome data adequately handled? A review of published randomized controlled trials in major medical journals , 2004, Clinical trials.

[4]  Julian P T Higgins,et al.  Controlling the risk of spurious findings from meta‐regression , 2004, Statistics in medicine.

[5]  P Hajek,et al.  Aversive smoking for smoking cessation. , 2001, The Cochrane database of systematic reviews.

[6]  Masatoshi Tanaka,et al.  Prophylactic effect of neuroleptics in symptom-free schizophrenics: A comparative dose-response study of haloperidol and propericiazine , 2004, Psychopharmacology.

[7]  Masatoshi Tanaka,et al.  Prophylactic effect of neuroleptics in symptom-free schizophrenics , 2004, Psychopharmacology.

[8]  Nicole A. Lazar,et al.  Statistical Analysis With Missing Data , 2003, Technometrics.

[9]  Daniel O Scharfstein,et al.  Incorporating prior beliefs about selection bias into the analysis of randomized trials with missing outcomes. , 2003, Biostatistics.

[10]  D. Altman,et al.  Measuring inconsistency in meta-analyses , 2003, BMJ : British Medical Journal.

[11]  L. Magder,et al.  Simple approaches to assess the possible impact of missing outcome information on estimates of risk ratios, odds ratios, and risk differences. , 2003, Controlled clinical trials.

[12]  Sally Hollis,et al.  A graphical sensitivity analysis for clinical trials with non‐ignorable missing binary outcome , 2002, Statistics in medicine.

[13]  Roderick J. A. Little,et al.  Statistical Analysis with Missing Data: Little/Statistical Analysis with Missing Data , 2002 .

[14]  S. Thompson,et al.  How should meta‐regression analyses be undertaken and interpreted? , 2002, Statistics in medicine.

[15]  Michael E. Miller,et al.  Group comparisons involving missing data in clinical trials: a comparison of estimates and power (size) for some simple approaches , 2001, Statistics in medicine.

[16]  Douglas G Altman,et al.  Systematic reviews in health care: Assessing the quality of controlled clinical trials. , 2001, BMJ.

[17]  P. Anderson,et al.  Smoking cessation in patients with chronic obstructive pulmonary disease: a double-blind, placebo-controlled, randomised trial , 2001, The Lancet.

[18]  Geert Molenberghs,et al.  Sensitivity analysis for incomplete categorical data , 2001 .

[19]  R Henderson,et al.  Joint modelling of longitudinal measurements and event time data. , 2000, Biostatistics.

[20]  S. Hollis,et al.  What is meant by intention to treat analysis? Survey of published randomised controlled trials , 1999, BMJ.

[21]  James M. Robins,et al.  Semiparametric Regression for Repeated Outcomes With Nonignorable Nonresponse , 1998 .

[22]  Jonathan J. Forster,et al.  Model‐based inference for categorical survey data subject to non‐ignorable non‐response , 1998 .

[23]  L. Arvanitis,et al.  Multiple fixed doses of “Seroquel” (quetiapine) in patients with acute exacerbation of schizophrenia: A comparison with haloperidol and placebo , 1997, Biological Psychiatry.

[24]  G. Tollefson,et al.  Olanzapine versus placebo and haloperidol: acute phase results of the North American double-blind olanzapine trial. , 1996, Neuropsychopharmacology : official publication of the American College of Neuropsychopharmacology.

[25]  Joseph B. Kadane,et al.  Subjective Bayesian analysis for surveys with missing data , 1993 .

[26]  R. Little.  Pattern-Mixture Models for Multivariate Incomplete Data , 1993 .

[27]  A Labelle,et al.  A Canadian multicenter placebo-controlled study of fixed doses of risperidone and haloperidol in the treatment of chronic schizophrenic patients. , 1993, Journal of clinical psychopharmacology.

[28]  V. Kafantaris,et al.  Haloperidol in schizophrenic children: early findings from a study in progress. , 1992, Psychopharmacology bulletin.

[29]  B. Diamond,et al.  Risperidone: clinical safety and efficacy in schizophrenia. , 1992, Psychopharmacology bulletin.

[30]  A Whitehead,et al.  A general parametric approach to the meta-analysis of randomized clinical trials. , 1991, Statistics in medicine.

[31]  D. Rubin.  Multiple imputation for nonresponse in surveys , 1989 .

[32]  D. Rubin,et al.  Statistical Analysis with Missing Data. , 1989 .

[33]  N. Laird,et al.  Meta-analysis in clinical trials. , 1986, Controlled clinical trials.

[34]  Erik V. Nordheim,et al.  Inference from Nonrandomly Missing Categorical Data: An Example from a Genetic Study on Turner's Syndrome , 1984 .

[35]  A double-blind controlled trial of pipotiazine, haloperidol and placebo in recently-hospitalized acute schizophrenic patients. , 1983, Brazilian journal of medical and biological research = Revista brasileira de pesquisas medicas e biologicas.

[36]  A L Gould,et al.  A new approach to the analysis of clinical drug trials with withdrawals. , 1980, Biometrics.

[37]  D. Rubin.  Formalizing Subjective Notions about the Effect of Nonrespondents in Sample Surveys , 1977 .

[38]  R. Mcclure,et al.  Loxapine succinate: a double-blind comparison with haloperidol and placebo in acute schizophrenics. , 1976, Current therapeutic research, clinical and experimental.

[39]  Howard Js rd.  Haloperidol for chronically hospitalized psychotics: a double-blind comparison with thiothixene and placebo; a follow-up open evaluation. , 1974 .

[40]  Reschke Rw.  Parenteral haloperidol for rapid control of severe, disruptive symptoms of acute schizophrenia. , 1974 .

[41]  R. Reschke.  Parenteral haloperidol for rapid control of severe, disruptive symptoms of acute schizophrenia. , 1974, Diseases of the nervous system.

[42]  J. S. Howard.  Haloperidol for chronically hospitalized psychotics: a double-blind comparison with thiothixene and placebo; a follow-up open evaluation. , 1974, Diseases of the nervous system.

[43]  E. Serafetinides,et al.  HALOPERIDOL, CLOPENTHIXOL, AND CHLORPROMAZINE IN CHRONIC SCHIZOPHRENIA: II. THE ELECTROENCEPHALOGRAPHIC EFFECTS OF CHEMICALLY UNRELATED ANTIPSYCHOTICS , 1972 .

[44]  E. Serafetinides,et al.  HALOPERIDOL, CLOPENTHIXOL, AND CHLORPROMAZINE IN CHRONIC SCHIZOPHRENIA: Chemically Unrelated Antipsychotics As Therapeutic Alternatives , 1972, The Journal of nervous and mental disease.

[45]  Simpson Gm,et al.  A controlled study of haloperidol in chronic schizophrenia. , 1967 .

[46]  J. Angus,et al.  A controlled study of haloperidol in chronic schizophrenia. , 1967, Current therapeutic research, clinical and experimental.

[47]  J. W. Garry,et al.  Haloperidol: a controlled trial in chronic schizophrenia. , 1962, The Journal of mental science.