Separating interviewer and sampling-point effects

Inter- viewer Behavior, Survey Sampling Abstract: The data used in empirical social-science research, especially in face-to-face surveys, are often collected in multistage cluster samples. The relative homo- geneity of the clusters selected in this could lead to design eects at the sampling stage. Interview- ers tend to further homogenize answers within the sampling points. The study presented here was de- signed to separate the two sources. Multilevel mod- els had been used to separate interviewer eects and sampling-point eects. Even though one would as- sume that a design eect in questions of "fear of crime in the neighborhood" should be due to spa- tial homogeneity it turned out that, for most of the items, the interviewer takes a far greater share of the homogenized eect than the spatial clustering does.

[1]  Die Priorität von Einstellungen und Verzerrungen im Interview. Eine Methodenuntersuchung anhand der Daten der Allgemeinen Bevölkerungsumfrage 1980 , 1983 .

[2]  James G. Booth,et al.  Resampling Methods for Sample Surveys , 1999 .

[3]  V. Vehovar,et al.  Interviewers' Effects in Telephone Surveys The case of International Victim Survey , 1995 .

[4]  Leslie Kish,et al.  Studies of Interviewer Variance for Attitudinal Variables , 1962 .

[5]  THEO VAN TILBURG Interviewer Effects in the Measurement of Personal Network Size , 1998 .

[6]  Elizabeth Martin,et al.  Chapter 16 – Surveys as Social Indicators: Problems in Monitoring Trends , 1983 .

[7]  C. Cannell A study of the effects of interviewers' expectations upon interviewing results / , 1953 .

[8]  Eli S. Marks,et al.  Influence of the Interviewer on the Accuracy of Survey Results , 1958 .

[9]  Eun Sul Lee,et al.  Analyzing Complex Survey Data , 1989 .

[10]  F. Kreuter Kriminalitätsfurcht: Messung und methodische Probleme , 2002 .

[11]  Robert M. Groves,et al.  Measuring and Explaining Interviewer Effects in Centralized Telephone Surveys , 1986 .

[12]  T. Tilburg,et al.  Interviewer Effects in the Measurement of Personal Network Size A Nonexperimental Study , 1998 .

[13]  Thomas F. Moore,et al.  An Interviewer Variance Study for the Eight Impact Cities of the National Crime Survey Cities Sample , 1978 .

[14]  J. Cuzick A Wilcoxon-type test for trend. , 1985, Statistics in medicine.

[15]  S. Stokes,et al.  Optimal Design of Interviewer Variance Experiments in Complex Surveys , 1985 .

[16]  Noreen Goldman,et al.  An assessment of estimation procedures for multilevel models with binary responses , 1995 .

[17]  Stuart A. Rice,et al.  Contagious Bias in the Interview: A Methodological Note , 1929, American Journal of Sociology.

[18]  Paul P. Biemer,et al.  A Review of Measurement Error Effects on the Analysis of Survey Data , 1997 .

[19]  Jun Shao,et al.  Invited Discussion Paper Resampling Methods in Sample Surveys , 1996 .

[20]  Leroy Bailey,et al.  Measures of Interviewer Bias and Variance , 1977 .

[21]  F. J. Fowler,et al.  Standardized Survey Interviewing: Minimizing Interviewer-Related Error. , 1989 .

[22]  Percy G. Gray,et al.  Examples of Interviewer Variability Taken from Two Sample Surveys , 1956 .

[23]  Bob Butcher,et al.  Interviewer and clustering effects in an attitude survey. , 1983 .

[24]  Colm O'Muircheartaigh,et al.  The relative impact of interviewer effects and sample design effects on survey precision , 1998 .

[25]  L. Kish,et al.  Inference from Complex Samples , 1974 .

[26]  Rainer Schnell,et al.  Neue Software-Werkzeuge zur Dokumentation der Fragebogenentwicklung , 2001 .

[27]  S. Rabe-Hesketh,et al.  Reliable Estimation of Generalized Linear Mixed Models using Adaptive Quadrature , 2002 .

[28]  K. Wolter Introduction to Variance Estimation , 1985 .

[29]  C. O'muircheartaigh Response errors in an attitudinal sample survey , 1976 .

[30]  Terance D. Miethe Fear and Withdrawal from Urban Life , 1995 .

[31]  Ivan P. Fellegi,et al.  Response Variance and its Estimation , 1964 .

[32]  Rainer Schnell,et al.  Multiple imputation for unit-nonresponse versus weighting including a comparison with a nonresponse follow-up study , 2004 .

[33]  R. Schnell Nonresponse in Bevölkerungsumfragen , 1997 .

[34]  Rainer Schnell,et al.  Das DEFECT-Projekt: Sampling-Errors und Nonsampling-Errors in komplexen Bevölkerungsstichproben , 2000 .

[35]  C. F. Cannell,et al.  Interviewing in social research. , 1955 .

[36]  W. J. Cobb,et al.  Interviewing in Social Research. , 1955 .

[37]  M. McPherson,et al.  Birds of a Feather: Homophily in Social Networks , 2001 .

[38]  Kosuke Imai,et al.  Survey Sampling , 1998, Nov/Dec 2017.

[39]  Clyde Tucker Interviewer Effects in Telephone Surveys , 1983 .

[40]  Eric R. Ziegel,et al.  Survey Errors and Survey Costs , 1990 .

[41]  Norbert Schwarz,et al.  Response Effects in Surveys , 1987 .