Estimation of an indicator of the representativeness of survey response

Nonresponse is a major source of estimation error in sample surveys. The response rate is widely used to measure survey quality associated with nonresponse, but is inadequate as an indicator because of its limited relation with nonresponse bias. Schouten et al. (2009) proposed an alternative indicator, which they refer to as an indicator of representativeness or R-indicator. This indicator measures the variability of the probabilities of response for units in the population. This paper develops methods for the estimation of this R-indicator assuming that values of a set of auxiliary variables are observed for both respondents and nonrespondents. We propose bias adjustments to the point estimator proposed by Schouten et al. (2009) and demonstrate the effectiveness of this adjustment in a simulation study where it is shown that the method is valid, especially for smaller sample sizes. We also propose linearization variance estimators which avoid the need for computer-intensive replication methods and show good coverage in the simulation study even when models are not fully specified. The use of the proposed procedures is also illustrated in an application to two business surveys at Statistics Netherlands.

[1]  R. Groves Nonresponse Rates and Nonresponse Bias in Household Surveys , 2006 .

[2]  Robert M. Groves,et al.  Using proxy measures and other correlates of survey outcomes to adjust for non‐response: examples from multiple surveys , 2010 .

[3]  R. Little Survey Nonresponse Adjustments for Estimates of Means , 1986 .

[4]  James Wagner,et al.  Adaptive survey design to reduce nonresponse bias , 2008 .

[5]  C. J. Skinner,et al.  Domain means, regression and multi-variate analysis , 1989 .

[6]  Jeroen Pannekoek,et al.  R-indexes for the comparison of different fieldwork strategies and data collection modes , 2007 .

[7]  D. Rubin Multiple imputation for nonresponse in surveys , 1989 .

[8]  Roger Tourangeau,et al.  Issues Facing the Field: Alternative Practical Measures of Representativeness of Survey Respondent Pools , 2008 .

[9]  Andreas Karlsson,et al.  Estimation in Surveys with Nonresponse , 2007, Technometrics.

[10]  R. Little Missing-Data Adjustments in Large Surveys , 1988 .

[11]  Geert Loosveldt,et al.  Minimizing survey refusal and noncontact rates: do our efforts pay off? , 2007 .

[12]  Jelke Bethlehem,et al.  Indicators for the representativeness of survey response , 2009 .

[13]  D. Rubin,et al.  Statistical Analysis with Missing Data. , 1989 .

[14]  Robert M. Groves,et al.  The Impact of Nonresponse Rates on Nonresponse Bias A Meta-Analysis , 2008 .

[15]  Natalie Shlomo,et al.  Indicators for monitoring and improving representativeness of response , 2011 .

[16]  Fannie Cobben,et al.  An empirical validation of R-indicators , 2008 .

[17]  Walter G. Egan Introduction to part B , 2000, SPIE Optics + Photonics.