Eye-tracking Social Desirability Bias

Eye tracking is now a common technique studying the moment-by-moment cognition of those processing visual information. Yet this technique has rarely been applied to different survey modes. Our paper uses an innovative method of real-world eye tracking to look at attention to sensitive questions and response scale points, in Web, face-to-face and paper-and-pencil self-administered (SAQ) modes. We link gaze duration to responses in order to understand how respondents arrive at socially desirable or undesirable answers. Our novel technique sheds light on how social desirability biases arise from deliberate misreporting and/or satisficing, and how these vary across modes.

[1]  B. Silver,et al.  Measurement and Mismeasurement of the Validity of the Self-reported Vote* , 1986 .

[2]  K. V. Meter.  Studying Survey Interviewers: A Call for Research and an Overview , 2005 .

[3]  D. Ballard,et al.  Eye movements in natural behavior , 2005, Trends in Cognitive Sciences.

[4]  Jon A. Krosnick,et al.  Social desirability bias in voter turnout reports Tests using the item count technique , 2010 .

[5]  D Holborow.  What the eye doesn't see. , 1976, Bulletin - N. Z. Society of Periodontology.

[6]  Timo Lenzner,et al.  A Comparison of Two Cognitive Pretesting Techniques Supported by Eye Tracking , 2016 .

[7]  Raymond M. Lee,et al.  Methodological Research on “Sensitive” Topics , 2012 .

[8]  Lars Kaczmirek,et al.  Seeing through the eyes of the respondent: an eye-tracking study on survey question comprehension , 2011 .

[9]  The Relationship Between Mode of Administration and Quality of Data in Survey Research: (final part)2 , 1991 .

[10]  The Relationship Between Mode of Administration and Quality of Data in Survey Research 1 , 1990 .

[11]  Shawn A. Ross,et al.  Survey Methodology , 2005, The SAGE Encyclopedia of the Sociology of Religion.

[12]  R. Tourangeau,et al.  Sensitive questions in surveys. , 2007, Psychological bulletin.

[13]  David N. Lee,et al.  Where we look when we steer , 1994, Nature.

[14]  David E. Wiley,et al.  Socially Desirable Responding: The Evolution of a Construct , 2001 .

[15]  Hennie Boeije,et al.  Honest by Chance: a Qualitative Interview Study to Clarify Respondents' (Non-)Compliance With Computer-Assisted Randomized Response , 2002 .

[16]  Bregje Holleman,et al.  Agree or Disagree? Cognitive Processes in Answering Contrastive Survey Questions , 2011 .

[17]  Paul D. Williams,et al.  A user's guide to the General Health Questionnaire , 1988 .

[18]  R. Velleman,et al.  'New Age' Travellers, Urban Slum Dwellers, Aborigines and Drug Users: Experiences of Collecting Sensitive Data From Marginalised Communities , 1997 .

[19]  P. Valkenburg,et al.  The Impact of “Forgiving” Introductions on the Reporting of Sensitive Behavior in Surveys The Role of Social Desirability Response Style and Developmental Status , 2011 .

[20]  K. V. Meter.  Sensitive Topics - Sensitive Questions: Overview of the Sociological Research Literature: , 2000 .

[21]  Shrikant I Bangdiwala.  Agree to disagree , 2012, International journal of injury control and safety promotion.

[22]  F. Strack,et al.  The impact of administration mode on response effects in survey measurement , 1991 .

[23]  Arthur C. Graesser,et al.  Question Understanding Aid (QUAID) A Web Facility that Tests Question Comprehensibility , 2006 .

[24]  K. Rayner.  The 35th Sir Frederick Bartlett Lecture: Eye movements and attention in reading, scene perception, and visual search , 2009, Quarterly journal of experimental psychology.

[25]  M. Larsen,et al.  The Psychology of Survey Response , 2002 .

[26]  P. Subramanian.  Active Vision: The Psychology of Looking and Seeing , 2006 .

[27]  T. Foulsham.  Eye movements and their functions in everyday tasks , 2015, Eye.

[28]  T. Foulsham,et al.  The where, what and when of gaze allocation in the lab and the natural environment , 2011, Vision Research.

[29]  A. Barton,et al.  Asking the Embarrassing Question , 1958 .

[30]  Mirta Galesic.  Use of Eye Tracking for Studying Survey Response Processes 1 , 2018, Social and Behavioral Research and the Internet.

[31]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[32]  Tom Foulsham,et al.  Real-world eye-tracking in face-to-face and web modes , 2014 .

[33]  Joel M. Moskowitz,et al.  Anonymous Versus Identifiable Self-Reports of Adolescent Drug Attitudes, Intentions, and Use , 1983 .

[34]  Eric M. Larson,et al.  An Innovative Technique for Asking Sensitive Questions: the Three-Card Method , 2002 .

[35]  J. Krosnick.  Response strategies for coping with the cognitive demands of attitude measures in surveys , 1991 .

[36]  Cleo D. Redline,et al.  Eye-Movement Analysis: A New Tool for Evaluating the Design of Visually Administered Instruments (Paper and Web) By , 2001 .

[37]  N. Menold,et al.  How Do Respondents Attend to Verbal Labels in Rating Scales? , 2014 .

[38]  Roger Tourangeau,et al.  Eye-Tracking Data: New Insights on Response Order Effects and Other Cognitive Shortcuts in Survey Responding. , 2008, Public opinion quarterly.

[39]  Harald Schoen,et al.  Exploring the Effects of Removing “Too Fast” Responses and Respondents from Web Surveys , 2015 .

[40]  Thomas Holtgraves,et al.  Social Desirability and Self-Reports: Testing Models of Socially Desirable Responding , 2004, Personality & social psychology bulletin.

[41]  Michael F. Land,et al.  From eye movements to actions: how batsmen hit the ball , 2000, Nature Neuroscience.

[42]  Matthew N. Beckmann,et al.  What Leads to Voting Overreports? Contrasts of Overreporters to Validated Voters and Admitted Nonvoters in the American National Election Studies , 2001 .

[43]  Keith Rayner.  Eye Movements in Reading , 2001 .

[44]  E. Leeuw,et al.  To mix or not to mix data collection modes in surveys. , 2005 .

[45]  Nadir Weibel,et al.  ChronoViz: a system for supporting navigation of time-coded data , 2011, CHI Extended Abstracts.

[46]  Lars Kaczmirek,et al.  Social and Behavioral Research and the Internet , 2010 .