A Comparison of Alternative Indicators for the Risk of Nonresponse Bias.

The response rate has played a key role in measuring the risk of nonresponse bias. However, recent empirical evidence has called into question the utility of the response rate for predicting nonresponse bias. The search for alternatives to the response rate has begun. The present article offers a typology for these indicators, briefly describes the strengths and weaknesses of each type, and suggests directions for future research. New standards for reporting on the risk of nonresponse bias may be needed. Certainly, any analysis into the risk of nonresponse bias will need to be multifaceted and include sensitivity analyses designed to test the impact of key assumptions about the data that are missing due to nonresponse.

[1]  Roger Tourangeau,et al.  Issues Facing the Field: Alternative Practical Measures of Representativeness of Survey Respondent Pools , 2008 .

[2]  Dong Xie,et al.  A successful conversion or double refusal: A study of the process of refusal conversion in telephone survey research , 2007 .

[3]  Jelke Bethlehem,et al.  Indicators for the representativeness of survey response , 2009 .

[4]  R. Groves,et al.  The Role of Topic Interest in Survey Participation Decisions , 2004 .

[5]  R. Groves.  Nonresponse Rates and Nonresponse Bias in Household Surveys , 2006 .

[6]  Tom W. Smith.  Estimating Nonresponse Bias with Temporary Refusals , 1984 .

[7]  Robert M. Groves,et al.  The Impact of Nonresponse Rates on Nonresponse Bias A Meta-Analysis , 2008 .

[8]  Paul P. Biemer,et al.  Introduction to Survey Quality , 2003 .

[9]  N. C. Schaeffer,et al.  Institute for Research on Poverty Discussion Paper no. 1024-93 Using Survey Participants to Estimate the Impact of Nonparticipation , 1993 .

[10]  Mick P. Couper,et al.  Usability Evaluation of Computer-Assisted Survey Instruments , 2000 .

[11]  C. Nicoletti.  Poverty analysis with missing data: alternative estimators compared , 2010 .

[12]  J. Gentle,et al.  An application of mathematical programming to sample allocation , 1997 .

[13]  M. Edelman,et al.  An Experiment on Improving Response Rates and Its Unintended Impact on Survey Error , 2009 .

[14]  A. Zaslavsky,et al.  Factors Affecting Response Rates to the Consumer Assessment of Health Plans Study Survey , 2002, Medical care.

[15]  Geert Loosveldt,et al.  Minimizing survey refusal and noncontact rates: do our efforts pay off? , 2007 .

[16]  R. Little.  Pattern-Mixture Models for Multivariate Incomplete Data , 1993 .

[17]  Mick P. Couper,et al.  Technology Trends in Survey Data Collection , 2005 .

[18]  T. Johnson,et al.  Using Community-Level Correlates to Evaluate Nonresponse Effects in a Telephone Survey , 2006 .

[19]  F. Kreuter,et al.  An Evaluation of Nonresponse Bias Using Paradata from a Health Survey , 2009 .

[20]  Natalie Shlomo,et al.  Indicators for monitoring and improving representativeness of response , 2011 .

[21]  Robert M. Groves,et al.  Using variation in response rates of demographic subgroups as evidence of nonresponse bias in survey estimates , 2009 .

[22]  R. Groves,et al.  Measurement Error, Unit Nonresponse, and Self-Reports of Abortion Experiences , 2010 .

[23]  R. Little,et al.  Does Weighting for Nonresponse Increase the Variance of Survey Means? (Conference Paper) , 2004 .

[24]  Peter Lynn,et al.  PEDAKSI: Methodology for Collecting Data about Survey Non-Respondents , 2003 .

[25]  Robert M. Groves,et al.  Using proxy measures and other correlates of survey outcomes to adjust for non‐response: examples from multiple surveys , 2010 .

[26]  George S. Day,et al.  Nonresponse Bias and Callbacks in Sample Surveys , 1973 .

[27]  Donald B. Rubin,et al.  Multiple imputation in mixture models for nonignorable nonresponse with follow-ups , 1993 .

[28]  E. Singer,et al.  The effects of response rate changes on the index of consumer sentiment. , 2000, Public opinion quarterly.

[29]  Michael A. Dimock,et al.  Gauging the Impact of Growing Nonresponse on Estimates from a National RDD Telephone Survey , 2006 .

[30]  Kristen Olson,et al.  Survey Participation, Nonresponse Bias, Measurement Error Bias, and Total Bias , 2006 .

[31]  James Wagner,et al.  Responsive Design for Household Surveys: Illustration of Management Interventions Based on Survey Paradata , 2008 .

[32]  Benjamin Skalland,et al.  An Alternative to the Response Rate for Measuring a Survey's Realization of the Target Population , 2011 .

[33]  Roderick J. A. Little,et al.  Statistical Analysis with Missing Data , 1988 .

[34]  Sixten Lundström,et al.  Assessing Auxiliary Vectors for Control of Nonresponse Bias in the Calibration Estimator , 2008 .

[35]  E. Ziegel,et al.  Nonresponse In Household Interview Surveys , 1998 .

[36]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[37]  J. Wagner.  The Fraction of Missing Information as a Tool for Monitoring the Quality of Survey Data , 2010 .

[38]  D. Rubin.  Multiple imputation for nonresponse in surveys , 1989 .

[39]  Roderick J. A. Little,et al.  Proxy Pattern-Mixture Analysis for Survey Nonresponse , 2011 .

[40]  R M Groves,et al.  Consequences of reducing nonresponse in a national telephone survey. , 2000, Public opinion quarterly.

[41]  J. Brick,et al.  Propensity to respond and nonresponse bias , 2008 .