Simple approaches to assess the possible impact of missing outcome information on estimates of risk ratios, odds ratios, and risk differences.

Often in clinical trials, the primary outcome is binary and the impact of an intervention is summarized using risk ratios (RRs), odds ratios (ORs), or risk differences (RDs). It is typical that in such studies, the binary outcome variable is not observed for some study participants. When there is missing data, it is well known that analyses based on those participants with complete data can be biased unless it can be assumed that the probability of a missing outcome is unrelated to the value of the missing binary outcome (i.e., missing at random). Unfortunately, this assumption cannot be assessed with the data since the missing outcomes, by definition, are not observed. One approach to this problem is to perform a sensitivity analysis to see the degree to which conclusions based only on the complete data would be affected given various degrees of departure from the missing at random assumption. In this paper we provide researchers formulae for doing such a sensitivity analysis. We quantify the departure from the missing at random assumption with a parameter we call the "response probability ratio" (RPR). This is the ratio between the probability of a nonmissing outcome among those with one value of the binary outcome and the probability of a nonmissing outcome among those with the other value of the outcome. Then we provide simple formulae for the estimation of the RRs, ORs, and RDs given any specific values of the RPRs. In addition to being useful for sensitivity analyses, these formulae provide some insight into the conditions that are necessary for bias to occur. In particular, it can be seen that, under certain plausible assumptions, OR estimates based on participants with complete data will be asymptotically unbiased, even if the probability of missing outcome depends on both the treatment and the outcome.

[1]  W F Rosenberger,et al.  Closed-form estimates for missing counts in two-way contingency tables. , 1992, Statistics in medicine.

[2]  C. Fuchs Maximum Likelihood Estimation and Model Selection in Contingency Tables with Missing Data , 1982 .

[3]  R. R. Hocking,et al.  The analysis of partially categorized contingency data. , 1974, Biometrics.

[4]  J P Matts,et al.  A graphical assessment of the potential impact of losses to follow-up on the validity of study results. The Terry Beirn Community Programs for Clinical Research on AIDS. , 1997, Statistics in medicine.

[5]  Sally Hollis,et al.  A graphical sensitivity analysis for clinical trials with non‐ignorable missing binary outcome , 2002, Statistics in medicine.

[6]  R. Royall Statistical Evidence: A Likelihood Paradigm , 1997 .

[7]  Michael G. Kenward,et al.  Nonrandom Missingness in Categorical Data: Strengt hs and Limitations , 1999 .

[8]  S. Pocock,et al.  Coping with missing data in clinical trials: A model‐based approach applied to asthma trials , 2002, Statistics in medicine.

[9]  J. Horowitz,et al.  Nonparametric Analysis of Randomized Experiments with Missing Covariate and Outcome Data , 2000 .

[10]  P. Holland,et al.  Discrete Multivariate Analysis. , 1976 .

[11]  H. Morgenstern,et al.  Epidemiologic Research: Principles and Quantitative Methods. , 1983 .

[12]  D. Rubin,et al.  Statistical Analysis with Missing Data. , 1989 .

[13]  Erik V. Nordheim,et al.  Inference from Nonrandomly Missing Categorical Data: An Example from a Genetic Study on Turner's Syndrome , 1984 .

[14]  S. Fienberg,et al.  Two-Dimensional Contingency Tables with Both Completely and Partially Cross-Classified Data , 1974 .

[15]  S. Blumenthal Multinomial Sampling With Partially Categorized Data , 1968 .

[16]  Janet Dixon Elashoff,et al.  Two-sample Problems for a Dichotomous Variable with Missing Data , 1974 .

[17]  W Vach,et al.  Logistic regression with incompletely observed categorical covariates--investigating the sensitivity against violation of the missing at random assumption. , 1995, Statistics in medicine.

[18]  N. Newman,et al.  Ischemic Optic Neuropathy Decompression Trial: twenty-four-month update. , 2000, Archives of ophthalmology.

[19]  J. Robins,et al.  Adjusting for Nonignorable Drop-Out Using Semiparametric Nonresponse Models , 1999 .

[20]  K. Delucchi Methods for the analysis of binary outcome results in the presence of missing data. , 1994, Journal of consulting and clinical psychology.

[21]  Nan M. Laird,et al.  Regression Analysis for Categorical Variables with Outcome Subject to Nonignorable Nonresponse , 1988 .