The Impact of Nonresponse Rates on Nonresponse Bias A Meta-Analysis

Fifty-nine methodological studies were designed to estimate the magnitude of nonresponse bias in statistics of interest. These studies use a variety of designs: sampling frames with rich variables, data from administrative records matched to sample case, use of screening-interview data to describe nonrespondents to main interviews, followup of nonrespondents to initial phases of field effort, and measures of behavior intentions to respond to a survey. This permits exploration of which circumstances produce a relationship between nonresponse rates and nonresponse bias and which, do not. The predictors are design features of the surveys, characteristics of the sample, and attributes of the survey statistics computed in the surveys.

[1]  E. Ziegel,et al.  Nonresponse In Household Interview Surveys , 1998 .

[2]  J. Lonner,et al.  Response bias: effect on outcomes evaluation by mail surveys after total knee arthroplasty. , 2004, The Journal of bone and joint surgery. American volume.

[3]  E. Barrett-Connor,et al.  Differences between respondents and non-respondents in a population-based cardiovascular disease study. , 1978, American journal of epidemiology.

[4]  G. Cohen,et al.  Are nonrespondents to health surveys less healthy than respondents , 2002 .

[5]  J. Goyder,et al.  The Silent Minority: Nonrespondents on Sample Surveys , 1991 .

[6]  John Van Hoewyk,et al.  A multivariate technique for multiply imputing missing values using a sequence of regression models , 2001 .

[7]  Susan Sprachman,et al.  Costs and Benefits of Improving Response Rates for a Hard-to-Reach Population , 2003 .

[8]  Trevillore E. Raghunathan,et al.  IVEware: Imputation and Variance Estimation Software User Guide , 2002 .

[9]  Dike van de Mheen,et al.  Non-response bias in a sample survey on alcohol consumption. , 2002, Alcohol and alcoholism.

[10]  B. Stuart,et al.  Assessment and Control of Nonresponse Bias in a Survey of Medicine Use by the Elderly , 1994, Medical care.

[11]  J. Grosset.  The Biasing Effects of Nonresponses on Information Gathered by Mail Surveys. Institutional Research Report No. 78. , 1994 .

[12]  J. Bethlehem.  Weighting nonresponse adjustments based on auxiliary information , 2002 .

[13]  Nona Tollefson,et al.  Response bias in college freshmen's responses to mail surveys , 1987 .

[14]  Roger Tourangeau,et al.  Experiments in Producing Nonresponse Bias , 2006 .

[15]  C. Steeh.  Trends in Nonresponse Rates, 1952–1979 , 1981 .

[16]  M. Schroll,et al.  Differences between participants and non-participants in a population study on nutrition and health in the elderly. , 1992, European journal of clinical nutrition.

[17]  L. Nyström,et al.  Non-responders to a postal questionnaire on respiratory symptoms and diseases , 1999, European Journal of Epidemiology.

[18]  T V Perneger,et al.  Analysis of non-response bias in a mailed health survey. , 1997, Journal of clinical epidemiology.

[19]  Timothy C. Haab,et al.  Telephone presurveys, self-selection, and non-response bias to mail and Internet surveys in economic research , 2004 .

[20]  S. Kiesler,et al.  SELF-SELECTED AND RANDOMLY SELECTED RESPONDENTS IN A COMPUTER NETWORK SURVEY , 1992 .

[21]  Douglas A. McManus,et al.  Sampling for Household Financial Characteristics Using Frame Information on Past Income , 1993 .

[22]  D. Rubin.  Multiple imputation for nonresponse in surveys , 1989 .

[23]  R. Groves.  Nonresponse Rates and Nonresponse Bias in Household Surveys , 2006 .

[24]  D. Robertson,et al.  Response bias in a health status survey of elderly people. , 1989, Age and ageing.

[25]  R. Voogt,et al.  Nonresponse Bias and Stimulus Effects in the Dutch National Election Study , 2002 .

[26]  A. Paganini-Hill,et al.  Comparison of early and late respondents to a postal health survey questionnaire. , 1993, Epidemiology.

[27]  Christopher Cornwell,et al.  Survey Response‐Related Biases in Contingent Valuation: Concepts, Remedies, and Empirical Application to Valuing Aquatic Plant Management , 2000 .

[28]  Edith D. de Leeuw,et al.  The Influence of Advance Letters on Response in Telephone Surveys A Meta-Analysis , 2007 .

[29]  R. Bolstein.  COMPARISON OF THE LIKELIHOOD TO VOTE AMONG PREELECTION POLL RESPONDENTS AND NONRESPONDENTS , 1991 .

[30]  Henry Assael,et al.  Nonsampling vs. Sampling Errors in Survey Research , 1982 .

[31]  A. Luong,et al.  Employee attitude surveys: examining the attitudes of noncompliant employees. , 2000, The Journal of applied psychology.

[32]  N. Bradburn.  PRESIDENTIAL ADDRESS: A RESPONSE TO THE NONRESPONSE PROBLEM , 1992 .

[33]  M Goldberg,et al.  Socioeconomic, demographic, occupational, and health factors associated with participation in a long-term epidemiologic survey: a prospective study of the French GAZEL cohort and its target population. , 2001, American journal of epidemiology.

[34]  Paul B. Sheatsley,et al.  Nonresponse Bias for Attitude Questions , 1981 .

[35]  J. Breitner,et al.  Characteristics of Nonresponders in A Community Survey of the Elderly , 1994, Journal of the American Geriatrics Society.

[36]  E. D. de Leeuw,et al.  Trends in household survey nonresponse: a longitudinal and international comparison , 2002 .

[37]  Peder J. Pedersen.  Non-Response Bias – A Study Using Matched Survey-Register Labour Market Data , 2002 .

[38]  R. Knibbe,et al.  Bias due to non-response in a Dutch survey on alcohol consumption. , 1988, British journal of addiction.

[39]  R M Groves,et al.  Consequences of reducing nonresponse in a national telephone survey. , 2000, Public opinion quarterly.

[40]  J. House,et al.  Effects of urban residence on interpersonal trust and helping behavior. , 1978 .

[41]  M. Wildner.  Lost to follow-up. , 1995, The Journal of bone and joint surgery. British volume.

[42]  D. Kendrick,et al.  Do safety practices differ between responders and non-responders to a safety questionnaire? , 2001, Injury prevention : journal of the International Society for Child and Adolescent Injury Prevention.

[43]  J. Cunningham,et al.  Nonresponse in a follow-up to a representative telephone survey of adult drinkers. , 2001, Journal of studies on alcohol.

[44]  R. Groves,et al.  The Role of Topic Interest in Survey Participation Decisions , 2004 .

[45]  Patrick Van Kenhove,et al.  The influence of topic involvement on mail survey response behavior , 2002 .

[46]  N. C. Schaeffer,et al.  Institute for Research on Poverty Discussion Paper no. 1024-93 Using Survey Participants to Estimate the Impact of Nonparticipation , 1993 .

[47]  Willis J. Goudy,et al.  Nonresponse Effects on Relationships Between Variables , 1976 .

[48]  L. McNutt,et al.  Intimate partner violence prevalence estimation using telephone surveys: understanding the effect of nonresponse bias. , 2000, American journal of epidemiology.

[49]  K. Stronks,et al.  The impact of response bias on estimates of health care utilization in a metropolitan area: the use of administrative data. , 1999, International journal of epidemiology.

[50]  P C O'Brien,et al.  Non-response bias in studies of diabetic complications: the Rochester Diabetic Neuropathy Study. , 1993, Journal of clinical epidemiology.

[51]  John O. Brehm.  The Phantom Respondents: Opinion Surveys and Political Representation , 1993 .

[52]  R. Rylander,et al.  Exposure to Anaesthetic Gases and Spontaneous Abortion: Response Bias in a Postal Questionnaire Study , 1982 .

[53]  R. Bergstrand,et al.  Bias due to non-participation and heterogenous sub-groups in population surveys. , 1983, Journal of chronic diseases.

[54]  D. Reed,et al.  Response bias in the Honolulu Heart Program. , 1989, American journal of epidemiology.

[55]  Susan Purdon,et al.  Can you hear me knocking? and investigation into the impact of interviewers on survey response rates , 1997 .

[56]  S. Blair,et al.  Patterns of non-response to a mail survey. , 1990, Journal of clinical epidemiology.

[57]  E. Singer,et al.  Leverage-saliency theory of survey participation: description and an illustration. , 2000, Public opinion quarterly.

[58]  K. Sheikh,et al.  Investigating non-response bias in mail surveys. , 1981, Journal of epidemiology and community health.

[59]  J. Goyder,et al.  The Silent Minority: Nonrespondents on Sample Surveys. , 1989 .

[60]  D. Balzi,et al.  Nine-year follow-up of a survey on smoking habits in Florence (Italy): higher mortality among non-responders. , 2002, International journal of epidemiology.

[61]  T. Perneger,et al.  Nonresponse Bias in a Survey of Patient Perceptions of Hospital Care , 2005, Medical care.

[62]  C. McCreary,et al.  Personality Comparisons of Responders and Nonresponders to a Mailed Personality Inventory , 1983 .

[63]  Elderly nonrespondents to a mail survey: a telephone follow-up. , 1993, Special care in dentistry : official publication of the American Association of Hospital Dentists, the Academy of Dentistry for the Handicapped, and the American Society for Geriatric Dentistry.

[64]  G. Rosenthal,et al.  An evaluation of the impact of nonresponse bias on patient satisfaction surveys. , 1997, Medical care.