Effects of Interviewer Attitudes and Behaviors on Refusal in Household Surveys

Interviewers play a crucial role in gaining cooperation from a sample unit. This paper aims to identify the interviewer characteristics that influence survey cooperation. Of principal interest to survey practitioners are interviewer attributes associated with higher cooperation rates, particularly among sample members whose characteristics are traditionally associated with a lower probability of response. Our data source is unusually rich, in that it contains extensive information on interviewers, including their attitudes and behaviors, which are linked to detailed information on both responding and nonresponding sample units. An important value of the data is that they permit examining a host of as yet unanswered questions about whether some interviewer attributes stimulate cooperation among some respondents but not others. In short, we investigate whether some sample units react favorably to certain interviewer characteristics. A multilevel cross-classified logistic model with random interviewer effects is used to account for clustering of households within interviewers, due to unmeasured interviewer attributes, and for the cross-classification of interviewers within areas. The model allows for statistical interactions between interviewer and household characteristics.

[1]  Gabriele B. Durrant,et al.  Multilevel modelling of refusal and noncontact nonresponse in household surveys: evidence from six UK government surveys , 2007 .

[2]  M. Killias,et al.  Different Measures of Vulnerability in Their Relation to Different Dimensions of Fear of Crime , 2000 .

[3]  H. Goldstein Multilevel Statistical Models , 2006 .

[4]  DOUGLAS W. MAYNARD,et al.  Keeping the Gate , 1997 .

[5]  Eli S. Marks,et al.  Influence of the Interviewer on the Accuracy of Survey Results , 1958 .

[6]  Mick P. Couper,et al.  MEASURING SURVEY QUALITY IN A CASIC ENVIRONMENT , 2002 .

[7]  James Durbin,et al.  Differences in response rates of experienced and inexperienced interviewers , 1951 .

[8]  Joop J. Hox,et al.  The influence of interviewers' attitude and behaviour on household survey nonresponse: an international comparison , 2002 .

[9]  Geert Loosveldt,et al.  A simultaneous analysis of interviewer effects on various data quality indicators with identification of exceptional interviewers , 2004 .

[10]  Patrick Sturgis,et al.  The Scope for Reducing Refusals in Household Surveys: An Investigation Based on Transcripts of tape-recorded Doorstep Interactions , 1998 .

[11]  R. Groves,et al.  Gender Effects among Telephone Interviewers in a Survey of Economic Attitudes , 1985 .

[12]  B. Föger The FIELD study , 2006, The Lancet.

[13]  J. J. Hox,et al.  Hierarchical Regression Models for Interviewer and Respondent Effects , 1994 .

[14]  Robert M. Groves,et al.  The Impact of Nonresponse Rates on Nonresponse Bias A Meta-Analysis , 2008 .

[15]  Robert M. Groves,et al.  UNDERSTANDING THE DECISION TO PARTICIPATE IN A SURVEY , 1992 .

[16]  Gabriele B. Durrant,et al.  Multilevel modelling of refusal and non‐contact in household surveys: evidence from six UK Government surveys , 2009 .

[17]  Edgar W. Butler,et al.  Some Sources of Interviewer Variance in Surveys , 1976 .

[18]  E. Kane,et al.  INTERVIEWER GENDER AND GENDER ATTITUDES , 1993 .

[19]  Geert Loosveldt,et al.  The Effects of Interviewer and Respondent Characteristics on Response Behavior in Panel Surveys , 2001 .

[20]  R. Millikan,et al.  Participation rates in a case-control study: the impact of age, race, and race of interviewer. , 1999, Annals of epidemiology.

[21]  Thomas F. Moore,et al.  An Interviewer Variance Study for the Eight Impact Cities of the National Crime Survey Cities Sample , 1978 .

[22]  J. Feldman,et al.  A Field Study of Interviewer Effects on the Quality of Survey Data , 1951 .

[23]  Colm O'Muircheartaigh,et al.  A multilevel exploration of the role of interviewers in survey non‐response , 1999 .

[24]  A. Hoogendoorn,et al.  Do interviewer voice characteristics influence unit response in telephone surveys , 2005 .

[25]  Francisco Flores-Macias,et al.  Effects of Interviewer Gender on Survey Responses: Findings from a Household Survey in Mexico , 2008 .

[26]  J. van der Zouwen,et al.  Standardization and tacit knowledge : interaction and practice in the survey interview , 2002 .

[27]  A. Hoogendoorn,et al.  DO INTERVIEWERS ’ VOICE CHARACTERISTICS INFLUENCE COOPERATION RATES IN TELEPHONE SURVEYS ? , 2006 .

[28]  G. Loosveldt,et al.  A Multilevel Multinomial Analysis of Interviewer Effects on Various Components of Unit Nonresponse , 2002 .

[29]  William J Browne,et al.  MCMC Estimation in MLwiN (Version 2.13) Centre for Multilevel Modelling, University of Bristol , 2009 .

[30]  R M Groves,et al.  Consequences of reducing nonresponse in a national telephone survey. , 2000, Public opinion quarterly.

[31]  Ian H. Langford,et al.  A User’s Guide to MLwiN, Version 2.10 , 2000 .

[32]  Rainer Schnell,et al.  Separating interviewer and sampling-point effects , 2003 .

[33]  E. Ziegel,et al.  Nonresponse In Household Interview Surveys , 1998 .

[34]  F. J. Fowler,et al.  Standardized Survey Interviewing: Minimizing Interviewer-Related Error. , 1989 .

[35]  Kasper M. Hansen The Effects of Incentives, Interview Length, and Interviewer Characteristics on Response Rates in a CATI-Study , 2006 .

[36]  F. J. Fowler,et al.  Standardized Survey Interviewing , 1990 .

[37]  Bradley P. Carlin,et al.  Bayesian measures of model complexity and fit , 2002 .