Evaluating, Comparing, Monitoring, and Improving Representativeness of Survey Response Through R‐Indicators and Partial R‐Indicators

Summary Non-response is a common source of error in many surveys. Because surveys often are costly instruments, quality-cost trade-offs play a continuing role in the design and analysis of surveys. The advances of telephone, computers, and Internet all had and still have considerable impact on the design of surveys. Recently, a strong focus on methods for survey data collection monitoring and tailoring has emerged as a new paradigm to efficiently reduce non-response error. Paradata and adaptive survey designs are key words in these new developments. Prerequisites to evaluating, comparing, monitoring, and improving quality of survey response are a conceptual framework for representative survey response, indicators to measure deviations thereof, and indicators to identify subpopulationsthatneedincreasedeffort.Inthispaper,wepresentanoverviewofrepresentativeness indicators or R-indicators that are fit for these purposes. We give several examples and provide guidelines for their use in practice.

[1]  Roderick J. A. Little,et al.  Statistical Analysis with Missing Data: Little/Statistical Analysis with Missing Data , 2002 .

[2]  Robert M. Groves,et al.  Responsive design for household surveys: tools for actively controlling survey errors and costs , 2006 .

[3]  Jelke Bethlehem,et al.  Indicators for the representativeness of survey response , 2009 .

[4]  Natalie Shlomo,et al.  Indicators for monitoring and improving representativeness of response , 2011 .

[5]  Andrey Peytchev,et al.  Reduction of Nonresponse Bias through Case Prioritization , 2010 .

[6]  Natalie Shlomo,et al.  Estimation of an indicator of the representativeness of survey response , 2012 .

[7]  Chris Mohl Research and Responsive Design Options for Survey Data Collection at Statistics Canada , 2007 .

[8]  J. Wagner The Fraction of Missing Information as a Tool for Monitoring the Quality of Survey Data , 2010 .

[9]  Roger Tourangeau,et al.  Issues Facing the Field: Alternative Practical Measures of Representativeness of Survey Respondent Pools , 2008 .

[10]  Paul P. Biemer,et al.  Introduction to Survey Quality , 2003 .

[11]  Robert M. Groves,et al.  Survey Errors and Survey Costs: Groves/Survey Errors , 2005 .

[12]  Robert M. Groves,et al.  Using proxy measures and other correlates of survey outcomes to adjust for non‐response: examples from multiple surveys , 2010 .

[13]  R. Groves Nonresponse Rates and Nonresponse Bias in Household Surveys , 2006 .

[14]  Robert M. Groves,et al.  The Impact of Nonresponse Rates on Nonresponse Bias A Meta-Analysis , 2008 .

[15]  Carl-Erik Särndal,et al.  The 2010 Morris Hansen lecture dealing with survey nonresponse in data collection, in estimation , 2011 .

[16]  R. Groves,et al.  Survey Errors and Survey Costs. , 1991 .

[17]  Roderick J. A. Little,et al.  Proxy Pattern-Mixture Analysis for Survey Nonresponse , 2011 .

[18]  James Wagner,et al.  Adaptive survey design to reduce nonresponse bias , 2008 .

[19]  D. Rubin,et al.  Statistical Analysis with Missing Data. , 1989 .

[20]  B. Schouten A selection strategy for weighting variables under a not-missing-at-random assumption , 2007 .

[21]  Sarah F. Riley,et al.  Reduction of Nonresponse Bias in Surveys through Case Prioritization , 2010 .