Using Imputation Techniques to Evaluate Stopping Rules in Adaptive Survey Designs

Adaptive Design methods for social surveys utilize the information from the data as it is collected to make decisions about the sampling design. In some cases, the decision is either to continue or stop the data collection. We evaluate this decision by proposing measures to compare the collected data with follow-up samples. The options are assessed by imputation of the nonrespondents under different missingness scenarios, including Missing Not at Random. The variation in the utility measures is compared to the cost induced by the follow-up sample sizes. We apply the proposed method to the 2007 U.S. Census of Manufacturers.

[1]  Jerome P. Reiter,et al.  Multiple Imputation of Missing or Faulty Values Under Linear Constraints , 2014 .

[2]  M. Kenward,et al.  Informative Drop‐Out in Longitudinal Data Analysis , 1994 .

[3]  Frank Ridzi,et al.  A New Way of Doing Business , 2009 .

[4]  Natalie Shlomo,et al.  Indicators for monitoring and improving representativeness of response , 2011 .

[5]  Eric R. Ziegel,et al.  Survey Errors and Survey Costs , 1990 .

[6]  Anna Oganian,et al.  Global Measures of Data Utility for Microdata Masked for Disclosure Limitation , 2009, J. Priv. Confidentiality.

[7]  J. Sethuraman.  A CONSTRUCTIVE DEFINITION OF DIRICHLET PRIORS , 1991 .

[8]  Jelke Bethlehem,et al.  Indicators for the representativeness of survey response , 2009 .

[9]  Adrian E. Raftery,et al.  Bayesian Regularization for Normal Mixture Estimation and Model-Based Clustering , 2007, J. Classif..

[10]  Barry Schouten,et al.  Optimizing quality of response through adaptive survey designs , 2013 .

[11]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[12]  Jerome P. Reiter,et al.  Estimation of propensity scores using generalized additive models , 2008, Statistics in medicine.

[13]  James Wagner,et al.  Adaptive survey design to reduce nonresponse bias , 2008 .

[14]  Robert M. Groves,et al.  Responsive design for household surveys: tools for actively controlling survey errors and costs , 2006 .

[15]  Trivellore E Raghunathan,et al.  A new stopping rule for surveys , 2010, Statistics in medicine.

[16]  Natalie Shlomo,et al.  Evaluating, Comparing, Monitoring, and Improving Representativeness of Survey Response Through R‐Indicators and Partial R‐Indicators , 2012 .

[17]  S. Murphy,et al.  Optimal dynamic treatment regimes , 2003 .

[18]  Riten Mitra,et al.  Bayesian Nonparametric Inference - Why and How. , 2013, Bayesian analysis.

[19]  Lancelot F. James,et al.  Gibbs Sampling Methods for Stick-Breaking Priors , 2001 .

[20]  T. Ferguson.  A Bayesian Analysis of Some Nonparametric Problems , 1973 .

[21]  T. Ferguson.  BAYESIAN DENSITY ESTIMATION BY MIXTURES OF NORMAL DISTRIBUTIONS , 1983 .

[22]  R Sowmya Rao,et al.  Stopping rules for surveys with multiple waves of nonrespondent follow‐up , 2008, Statistics in medicine.

[23]  William S. Reece,et al.  Imputation of Missing Values When the Probability of Response Depends on the Variable Being Imputed , 1982 .

[24]  Michael A. West,et al.  Hierarchical priors and mixture models, with applications in regression and density estimation , 2006 .

[25]  Natalie Shlomo,et al.  Estimation of an indicator of the representativeness of survey response , 2012 .

[26]  M. Escobar,et al.  Bayesian Density Estimation and Inference Using Mixtures , 1995 .