Unconscious Physiological Effects of Search Latency on Users and Their Click Behaviour

Understanding the impact of a search system's response latency on its users' searching behaviour has been recently an active research topic in the information retrieval and human-computer interaction areas. Along the same line, this paper focuses on the user impact of search latency and makes the following two contributions. First, through a controlled experiment, we reveal the physiological effects of response latency on users and show that these effects are present even at small increases in response latency. We compare these effects with the information gathered from self-reports and show that they capture the nuanced attentional and emotional reactions to latency much better. Second, we carry out a large-scale analysis using a web search query log obtained from Yahoo to understand the change in the way users engage with a web search engine under varying levels of increasing response latency. In particular, we analyse the change in the click behaviour of users when they are subject to increasing response latency and reveal significant behavioural differences.

[1]  Donald A. Hantula,et al.  The effects of download delay on performance and end-user satisfaction in an Internet tutorial , 2001, Comput. Hum. Behav..

[2]  Mark D. Smucker Towards Timed Predictions of Human Performance for Interactive Information Retrieval Evaluation , 2009 .

[3]  D. Watson,et al.  Development and validation of brief measures of positive and negative affect: the PANAS scales. , 1988, Journal of personality and social psychology.

[4]  N. Ravaja Contributions of Psychophysiology to Media Research: Review and Recommendations , 2004 .

[5]  James R. Lewis,et al.  IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use , 1995, Int. J. Hum. Comput. Interact..

[6]  B. Parkinson,et al.  Emotion and motivation , 1995 .

[7]  Fiona Fui-Hoon Nah,et al.  A study on tolerable waiting time: how long are Web users willing to wait? , 2004, AMCIS.

[8]  J. Cacioppo,et al.  The skeletomotor system: Surface electromyography. , 2007 .

[9]  David Maxwell,et al.  Stuck in traffic: how temporal delays affect search behaviour , 2014, IIiX.

[10]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[11]  Mounia Lalmas,et al.  On saliency, affect and focused attention , 2012, CHI.

[12]  Marc Hassenzahl,et al.  MARC HASSENZAHL CHAPTER 3 The Thing and I: Understanding the Relationship Between User and Product , 2003 .

[13]  Andrea K. Webb,et al.  Multilevel models for repeated measures research designs in psychophysiology: an introduction to growth curve modeling. , 2007, Psychophysiology.

[14]  E. Thompson Development and Validation of an Internationally Reliable Short-Form of the Positive and Negative Affect Schedule (PANAS) , 2007 .

[15]  Alan R. Dennis,et al.  Information foraging on the web: The effects of "acceptable" Internet delays on multi-page information search behavior , 2006, Decis. Support Syst..

[16]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[17]  Ryen W. White,et al.  Slow Search: Information Retrieval without Time Constraints , 2013, HCIR '13.

[18]  Wolfgang Prinz,et al.  Why don't we perceive our brain states? , 1992 .

[19]  Leif Azzopardi,et al.  How query cost affects search behavior , 2013, SIGIR.

[20]  T. Chartrand,et al.  THE UNBEARABLE AUTOMATICITY OF BEING , 1999 .

[21]  Jennifer Preece,et al.  A psychological investigation of long retrieval times on the World Wide Web , 1998, Interact. Comput..

[22]  B. Pompe,et al.  Permutation entropy: a natural complexity measure for time series. , 2002, Physical review letters.

[23]  B. Kahn,et al.  How Tolerable is Delay? Consumers’ Evaluations of Internet Web Sites after Waiting , 1998 .

[24]  Jacek Gwizdka,et al.  The role of subjective factors in the information search process , 2009, J. Assoc. Inf. Sci. Technol..

[25]  Leif Azzopardi,et al.  Modelling interaction with economic models of search , 2014, SIGIR.

[26]  Dennis F. Galletta,et al.  Web Site Delays: How Tolerant are Users? , 2004, J. Assoc. Inf. Syst..

[27]  Elaine Toms,et al.  The development and evaluation of a survey to measure user engagement , 2010, J. Assoc. Inf. Sci. Technol..

[28]  Berkant Barla Cambazoglu,et al.  Impact of response latency on user behavior in web search , 2014, SIGIR.

[29]  Nolan J. Taylor,et al.  Situation Normality and the Shape of Search: The Effects of Time Delays and Information Presentation on Search Behavior , 2012, J. Assoc. Inf. Sci. Technol..

[30]  M. Dawson,et al.  The electrodermal system , 2007 .

[31]  Hilary Hutchinson,et al.  User Preference and Search Engine Latency , 2008 .