Using number of failed contact attempts to adjust for non‐ignorable non‐response

Summary. We present a general method of adjustment for non-ignorable non-response in studies where one or more further attempts are made to contact initial non-responders. A logistic regression model relates the probability of response at each contact attempt to covariates and outcomes of interest. We assume that the effect of these covariates and outcomes on the probability of response is the same at all contact attempts. Knowledge of the number of contact attempts enables estimation of the model by using only information from the respondents and the number of non-responders.Three approaches for fitting the response models and estimating parameters of substantive interest and their standard errors are compared: a modified conditional likelihood method in which the fitted inverse probabilities of response are used in weighted analyses for the outcomes of interest, an EM procedure with the Louis formula and a Bayesian approach using Markov chain Monte Carlo methods. We further propose the creation of several sets of weights to incorporate uncertainty in the probability weights in subsequent analyses. Our methods are applied as a sensitivity analysis to a postal survey of symptoms in Persian Gulf War veterans and other servicemen.

[1]  Carmen Anido,et al.  An iterative estimating procedure for probit-type nonresponse models in surveys with call backs , 2000 .

[2]  Susan Purdon,et al.  Can you hear me knocking? and investigation into the impact of interviewers on survey response rates , 1997 .

[3]  Roger A. Sugden,et al.  Multiple Imputation for Nonresponse in Surveys , 1988 .

[4]  Paul Clarke,et al.  The effects of extended interviewer effort on non-response bias , 2001 .

[5]  Peter Lynn,et al.  Separating refusal bias and non-contact bias: evidence from UK national surveys , 2002 .

[6]  T. Louis Finding the Observed Information Matrix When Using the EM Algorithm , 1982 .

[7]  Roderick J. A. Little,et al.  Modeling the Drop-Out Mechanism in Repeated-Measures Studies , 1995 .

[8]  Robert H Lyles,et al.  Missing data in the 2 x 2 table: patterns and likelihood-based analysis for cross-sectional studies with supplemental sampling. , 2003, Statistics in medicine.

[9]  Tim Croudace,et al.  A modelling strategy for the analysis of clinical trials with partly missing longitudinal data , 2003, International journal of methods in psychiatric research.

[10]  D. Rubin Multiple imputation for nonresponse in surveys , 1989 .

[11]  G Molenberghs,et al.  Identifying the types of missingness in quality of life data from clinical trials. , 1998, Statistics in medicine.

[12]  Kenneth G. Manton,et al.  Correcting for nonavailability bias in surveys by weighting based on number of callbacks , 1993 .

[13]  Andrew Copas,et al.  Dealing with non‐ignorable non‐response by using an ‘enthusiasm‐to‐respond’ variable , 1998 .

[14]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[15]  Simon Wessely,et al.  Health of UK servicemen who served in Persian Gulf War , 1999, The Lancet.

[16]  A. Garratt,et al.  Problems in Using Health Survey Questionnaires in Older Patients with Physical Disabilities , 2001, Gerontology.

[17]  Tak K. Mak,et al.  ESTIMATION PROCEDURES FOR CATEGORICAL SURVEY DATA WITH NONIGNORABLE NONRESPONSE , 2001 .

[18]  D B Rubin,et al.  Multiple imputation in health-care databases: an overview and some applications. , 1991, Statistics in medicine.

[19]  Juha M. Alho,et al.  Adjusting for nonresponse bias using logistic regression , 1990 .