Misreporting to looping questions in surveys: recall, motivation and burden

"Looping questions are used to collect data about several similar events, such as employment spells, retirement accounts, or marriages. The questions collect information about the number of events experienced as well as details about each one. The questions require respondents to think hard to recall each event and are often lengthy and repetitive. Looping questions can be asked in two formats, and which format a survey uses may affect the quality of the data collected. We develop theory-based hypotheses about the effects that the choice of format has on measurement error in looping questions and test the hypotheses using experimental data from a recent web survey with a link to administrative records. Results show that one format collects more accurate event reports, but the other format provides higher quality data to the follow up questions. We conclude with guidance for those who write survey questions as well as those who rely on survey data for substantive analyses." (Author's abstract, IAB-Doku) ((en))

[1]  R. Groves,et al.  The 2006-2010 National Survey of Family Growth: sample design and analysis of a continuous survey. , 2010, Vital and health statistics. Series 2, Data evaluation and methods research.

[2]  Frauke Kreuter,et al.  Nonresponse and Measurement Error in Employment Research: Making Use of Administrative Data , 2010 .

[3]  F. Kreuter,et al.  The Effect of Benefit Wording on Consent to Link Survey and Administrative Records in a Web Survey , 2014 .

[4]  F P Stafford,et al.  Event history calendars and question list surveys: a direct comparison of interviewing methods. , 2001, Public opinion quarterly.

[5]  L. Rips,et al.  The Psychology of Survey Response , 2000 .

[6]  Jürgen Wiemers.  Endogenizing take-up of social assistance in a microsimulation model: a case study for Germany , 2014 .

[7]  Scot Burton,et al.  TASK CONDITIONS, RESPONSE FORMULATION PROCESSES, AND RESPONSE ACCURACY FOR BEHAVIORAL FREQUENCY QUESTIONS IN SURVEYS , 1991 .

[8]  E. Loftus,et al.  Retrieving Multiple Autobiographical Memories , 1985 .

[9]  G. Haas,et al.  Does Granting Linkage Consent in the Beginning of the Questionnaire Affect Data Quality , 2017 .

[10]  B. Matthes,et al.  Collecting Event Histories with TrueTales:Techniques to Improve Autobiographical Recall Problems in Standardized Interviews , 2007 .

[11]  F. Kreuter,et al.  Motivated misreporting: shaping answers to reduce survey burden , 2015 .

[12]  Don A. Dillman,et al.  Towards a Theory of Self‐Administered Questionnaire Design , 1997 .

[13]  W. Whitten,et al.  Directed search through autobiographical memory , 1981, Memory & cognition.

[14]  Lynette M. Smith,et al.  Methodological Comparisons Between CATI Event History Calendar and Standardized Conventional Questionnaire Instruments , 2007 .

[15]  E. Blair,et al.  Cognitive Processes Used by Survey Respondents to Answer Behavioral Frequency Questions , 1987 .

[16]  David Frohlich,et al.  On the organisation of form-filling behaviour , 1986 .

[17]  R. Belli,et al.  The structure of autobiographical memory and the event history calendar: potential improvements in the quality of retrospective reports in surveys. , 1998, Memory.

[18]  Roger Tourangeau,et al.  Motivated Underreporting in Screening Interviews , 2012 .

[19]  Antje Kirchner,et al.  Assessing the Mechanisms of Misreporting to Filter Questions in Surveys , 2014 .

[20]  H. Dietrich.  Jugendarbeitslosigkeit aus einer europäischen Perspektive: theoretische Ansätze, empirische Konzepte und ausgewählte Befunde , 2015 .

[21]  Mark Trappmann,et al.  Codebuch und Dokumentation des 'Pa- nel Arbeitsmarkt und soziale Sicherung' (PASS) , 2008 .

[22]  B. Christoph.  Empirische Maße zur Erfassung von Armut und materiellen Lebensbedingungen: Ansätze und Konzepte im Überblick , 2015 .

[23]  Stefan Seth,et al.  European Data Watch: The German Integrated Employment Biographies Sample IEBS , 2007 .

[24]  J. Krosnick.  Response strategies for coping with the cognitive demands of attitude measures in surveys , 1991 .

[25]  L. Sharp,et al.  Respondent Burden: A Test of Some Common Assumptions , 1983 .

[26]  N. Schwarz,et al.  Asking Questions About Behavior: Cognition, Communication, and Questionnaire Construction , 2001 .

[27]  F. Stafford,et al.  Calendar and Question-List Survey Methods: Association Between Interviewer Behaviors and Data Quality , 2004 .