Sampling for Web Surveys

Web surveys are frequently based on samples drawn from panels with large amounts of nonresponse or haphazard selection. The availability of large-scale consumer and voter databases provides large amounts of auxilliary information for both panelists and population members. Sample matching, where a conventional random sample is selected from a population frame and the clos- est matching respondent from the panel is selected for interviewing, is proposed. It is shown that under suitable assumptions (primarily ignorability of panel membership conditional upon the match- ing variables), the resulting survey estimates are consistent with an asymptotic normal distribution. Simulation results show that the matched sample estimators are superior to weighting a random sub- sample from the panel and have a similar sampling distribution to simple random sampling from the population. In an example involving the 2006 U.S. Congressional elections, estimates using sample matching from an opt-in Web panel outperformed estimates based on phone interviews with RDD samples.

[1]  G. Imbens,et al.  Large Sample Properties of Matching Estimators for Average Treatment Effects , 2004 .

[2]  Russell V. Lenth,et al.  Statistical Analysis With Missing Data (2nd ed.) (Book) , 2004 .

[3]  M. Couper.  A REVIEW OF ISSUES AND APPROACHES , 2000 .

[4]  Matthias Schonlau,et al.  Noncoverage and nonresponse in an Internet survey , 2007 .

[5]  Roderick J. A. Little,et al.  Statistical Analysis with Missing Data , 1988 .

[6]  D. Rubin,et al.  The central role of the propensity score in observational studies for causal effects , 1983 .

[7]  Jon A. Krosnick,et al.  The Effect of Survey Mode and Sampling on Inferences about Political Attitudes and Behavior: Comparing the 2000 and 2004 ANES to Internet Surveys with Nonprobability Samples , 2007, Political Analysis.

[8]  Sunghee Lee.  Propensity score adjustment as a weighting scheme for volunteer panel web surveys , 2006 .

[9]  Jelke Bethlehem,et al.  Computer Assisted Survey Information Collection , 1998 .

[10]  Lisa Thalji,et al.  Psychological reactions to terrorist attacks: findings from the National Study of Americans' Reactions to September 11. , 2002, JAMA.

[11]  Carl-Erik Särndal,et al.  Model Assisted Survey Sampling , 1997 .

[12]  T. M. F. Smith,et al.  On the validity of interferences from non-random samples , 1983 .

[13]  D. Rubin.  Matched Sampling for Causal Effects , 2006 .

[14]  Frederick Mosteller,et al.  Statistical Problems of the Kinsey Report , 1953 .

[15]  P. Jagers,et al.  Post-Stratification against Bias in Sampling , 1986 .