Selecting Adaptive Survey Design Strata with Partial R‐indicators

Recent survey literature shows an increasing interest in survey designs that adapt data collection to characteristics of the survey target population. Given a specified quality objective function, the designs attempt to find an optimal balance between quality and costs. Finding the optimal balance may not be straightforward as corresponding optimisation problems are often highly non-linear and non-convex. In this paper, we discuss how to choose strata in such designs and how to allocate these strata in a sequential design with two phases. We use partial R-indicators to build profiles of the data units where more or less attention is required in the data collection. In allocating cases, we look at two extremes: surveys that are run only once, or infrequent, and surveys that are run continuously. We demonstrate the impact of the sample size in a simulation study and provide an application to a real survey, the Dutch Crime Victimisation Survey.

[1]  Robert M. Groves,et al.  Responsive design for household surveys: tools for actively controlling survey errors and costs , 2006 .

[2]  Jelke Bethlehem,et al.  Indicators for the representativeness of survey response , 2009 .

[3]  Natalie Shlomo,et al.  Estimation of an indicator of the representativeness of survey response , 2012 .

[4]  J. Deville,et al.  Efficient balanced sampling: The cube method , 2004 .

[5]  F. Cobben Does balancing of survey response reduce nonresponse bias ? , 2012 .

[6]  Natalie Shlomo,et al.  Evaluating, Comparing, Monitoring, and Improving Representativeness of Survey Response Through R‐Indicators and Partial R‐Indicators , 2012 .

[7]  Joseph L. Schafer,et al.  Bayesian Penalized Spline Models for Statistical Process Monitoring of Survey Paradata Quality Indicators , 2013 .

[8]  Barry Schouten,et al.  Disentangling mode-specific selection and measurement bias in social surveys. , 2013, Social science research.

[9]  James Wagner,et al.  Use of Paradata in a Responsive Design Framework to Manage a Field Data Collection , 2012 .

[10]  James Wagner,et al.  Adaptive survey design to reduce nonresponse bias , 2008 .

[11]  Robert M. Groves,et al.  The Impact of Nonresponse Rates on Nonresponse Bias A Meta-Analysis , 2008 .

[12]  James Wagner,et al.  A Comparison of Alternative Indicators for the Risk of Nonresponse Bias. , 2012, Public opinion quarterly.

[13]  Barry Schouten,et al.  Optimizing quality of response through adaptive survey designs , 2013 .

[14]  Sarah F. Riley,et al.  Reduction of Nonresponse Bias in Surveys through Case Prioritization , 2010 .

[15]  James Wagner Adaptive Contact Strategies in Telephone and Face-to-Face Surveys , 2012 .

[16]  R. Little,et al.  Does Weighting for Nonresponse Increase the Variance of Survey Means? (Conference Paper) , 2004 .

[17]  Yves Tillé,et al.  Fast balanced sampling for highly stratified population , 2014, Comput. Stat. Data Anal..

[18]  Carl-Erik Särndal,et al.  The 2010 Morris Hansen lecture dealing with survey nonresponse in data collection, in estimation , 2011 .

[19]  B. Schouten Statistical inference based on randomly generated auxiliary variables , 2018 .

[20]  Anton Grafström,et al.  How to Select Representative Samples , 2014 .

[21]  Barry Schouten,et al.  Tailored fieldwork design to increase representative household survey response: an experiment in the Survey of Consumer Satisfaction , 2013 .

[22]  Robert M. Groves,et al.  Using variation in response rates of demographic subgroups as evidence of nonresponse bias in survey estimates , 2009 .

[23]  Natalie Shlomo,et al.  Indicators for monitoring and improving representativeness of response , 2011 .

[24]  Andrey Peytchev,et al.  Reduction of Nonresponse Bias through Case Prioritization , 2010 .

[25]  Carl-Erik Särndal,et al.  Aspects of Responsive Design with Applications to the Swedish Living Conditions Survey , 2013 .

[26]  Frost Hubbard,et al.  Producing Unbiased Estimates of Propensity Models During Data Collection , 2014 .

[27]  Peter Lundquist,et al.  ACCURACY IN ESTIMATION WITH NONRESPONSE: A FUNCTION OF DEGREE OF IMBALANCE AND DEGREE OF EXPLANATION , 2014 .