Investigating Users' Time Perception during Web Search

Due to the tremendous economic value of search result pages, search engine companies have invested a lot to improve their quality. Recently, much effort has been made to directly model key aspects of users' interactions with search system, for example, Benefit and Cost. Time has been widely adopted in both of the two aspects since benefit and cost must be expressed in meaningful units in practical application. Psychological studies have demonstrated that the subjectively perceived time might be different from the objective time measured by timing device and the time perception process of human beings is affected by some psychological factors, such as motivation and interest, which are closely related to the search process. Considering that time is usually used to describe the subject experience of search users, it is necessary to investigate the difference between perceived time and objective time in search process. In psychology, there is a temporal illusion effect named Vierordt's law, i.e. shorter intervals tend to be overestimated while longer intervals tend to be underestimated. In this work, we carefully designed a lab-study to examine the impact of duration length on user's time perception in the context of search. Experimental results show that Vierordt's law is consistently observed in Web search environment. This work could help us to correct the estimation of users' perceived time and provide insights about the mechanism of satisfaction.

[1]  Leif Azzopardi,et al.  Impacts of Time Constraints and System Delays on User Experience , 2016, CHIIR.

[2]  Ryen W. White,et al.  Personalized models of search satisfaction , 2013, CIKM.

[3]  Mary Czerwinski,et al.  Subjective Duration Assessment: An Implicit Probe for Software Usability , 2001 .

[4]  Philip A. Gable,et al.  Time Flies When You’re Having Approach-Motivated Fun , 2012, Psychological science.

[5]  Klaus Berberich,et al.  Identifying Time Intervals of Interest to Queries , 2014, CIKM.

[6]  Vagelis Hristidis,et al.  How fresh do you want your search results? , 2013, CIKM.

[7]  Fan Zhang,et al.  Does Document Relevance Affect the Searcher's Perception of Time? , 2017, WSDM.

[8]  J. T. Fraser,et al.  Time: Perspectives at the Millennium (the Study of Time X) , 2000 .

[9]  Mathias Schlögl,et al.  Time Well Spent. , 2018, Journal of palliative medicine.

[10]  Michael Keen,et al.  ASLIB CRANFIELD RESEARCH PROJECT FACTORS DETERMINING THE PERFORMANCE OF INDEXING SYSTEMS VOLUME 2 , 1966 .

[11]  Ahmed Hassan Awadallah,et al.  A semi-supervised approach to modeling web search satisfaction , 2012, SIGIR '12.

[12]  Dan Zakay,et al.  Relative and absolute duration judgments under prospective and retrospective paradigms , 1993 .

[13]  Jaime Arguello,et al.  Development and Evaluation of Search Tasks for IIR Experiments using a Cognitive Complexity Framework , 2015, ICTIR.

[14]  Robert G. Capra,et al.  Time pressure, user satisfaction and task difficulty , 2013, ASIST.

[15]  P. Wilton,et al.  Models of Consumer Satisfaction Formation : An Extension , 1988 .

[16]  Robert G. Capra,et al.  Differences in the Use of Search Assistance for Tasks of Varying Complexity , 2015, SIGIR.

[17]  Luis Gravano,et al.  Answering General Time-Sensitive Queries , 2008, IEEE Transactions on Knowledge and Data Engineering.

[18]  Steve Fox,et al.  Evaluating implicit measures to improve web search , 2005, TOIS.

[19]  P. Fraisse Perception and estimation of time. , 1984, Annual review of psychology.

[20]  Pertti Vakkari,et al.  Task-Based Information Interaction Evaluation , 2015, ACM Trans. Inf. Syst..

[21]  Nicholas J. Belkin,et al.  Exploring and predicting search task difficulty , 2012, CIKM '12.

[22]  Gerhard Weikum,et al.  A Language Modeling Approach for Temporal Information Needs , 2010, ECIR.

[23]  Diane Kelly,et al.  How does Interest in a Work Task Impact Search Behavior and Engagement? , 2016, CHIIR.

[24]  Bernard J. Jansen,et al.  Using the taxonomy of cognitive learning to model online searching , 2009, Inf. Process. Manag..

[25]  A. Meyer-Lindenberg,et al.  Age-related changes in midbrain dopaminergic regulation of the human reward system , 2008, Proceedings of the National Academy of Sciences.

[26]  Charles L. A. Clarke,et al.  Time-based calibration of effectiveness measures , 2012, SIGIR '12.

[27]  Ryen W. White,et al.  Slow Search: Information Retrieval without Time Constraints , 2013, HCIR '13.

[28]  Charles L. A. Clarke,et al.  Time well spent , 2014, IIiX.

[29]  Maarten de Rijke,et al.  A Context-aware Time Model for Web Search , 2016, SIGIR.

[30]  Benjamin B. Weybrew The Zeigarnik Phenomenon Revisited: Implications for Enhancement of Morale , 1984 .

[31]  Ryen W. White,et al.  Understanding and Predicting Graded Search Satisfaction , 2015, WSDM.

[32]  Ryen W. White,et al.  Time-critical search , 2014, SIGIR.

[33]  Richard A. Bwck Prospective and retrospective duration judgments: A meta-analytic review , 1997 .

[34]  Yiqun Liu,et al.  When does Relevance Mean Usefulness and User Satisfaction in Web Search? , 2016, SIGIR.

[35]  M. de Rijke,et al.  Using temporal bursts for query modeling , 2014, Information Retrieval.

[36]  Kjetil Nørvåg,et al.  Learning to rank search results for time-sensitive queries , 2012, CIKM.

[37]  Nicholas J. Belkin,et al.  A faceted approach to conceptualizing tasks in information seeking , 2008, Inf. Process. Manag..

[38]  Fan Zhang,et al.  Manipulating Time Perception of Web Search Users , 2016, CHIIR.

[39]  Berkant Barla Cambazoglu,et al.  Impact of response latency on user behavior in web search , 2014, SIGIR.

[40]  Leif Azzopardi,et al.  The economics in interactive information retrieval , 2011, SIGIR.

[41]  Benjamin S. Bloom,et al.  A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives , 2000 .

[42]  Brian D. Davison,et al.  Learning to rank for freshness and relevance , 2011, SIGIR.

[43]  R. E. Hicks,et al.  Concurrent processing demands and the experience of time-in-passing , 1977 .

[44]  Guido Zuccon,et al.  An Analysis of Theories of Search and Search Behavior , 2015, ICTIR.

[45]  Jonathon D. Crystal,et al.  The psychology of time , 2007, Behavioural Processes.

[46]  Norbert Fuhr,et al.  A probability ranking principle for interactive information retrieval , 2008, Information Retrieval.

[47]  Ryen W. White,et al.  Modeling dwell time to predict click-level satisfaction , 2014, WSDM.

[48]  Charles L. A. Clarke,et al.  IR Evaluation: Modeling User Behavior for Measuring Effectiveness , 2015, SIGIR.

[49]  Bernard J. Jansen,et al.  Investigating the effect of results ranking in sponsored search , 2011, ASIST.

[50]  Simon Grondin,et al.  Judging Multi-Minute Intervals Retrospectively , 2007, Quarterly journal of experimental psychology.

[51]  Miles Efron,et al.  Estimation methods for ranking recent information , 2011, SIGIR.

[52]  Peter Pirolli,et al.  Information Foraging , 2009, Encyclopedia of Database Systems.

[53]  Tetsuya Sakai,et al.  Summaries, ranked retrieval and sessions: a unified framework for information access evaluation , 2013, SIGIR.

[54]  Cyril W. Cleverdon,et al.  Aslib Cranfield research project - Factors determining the performance of indexing systems; Volume 1, Design; Part 2, Appendices , 1966 .

[55]  Jacek Gwizdka,et al.  Using dwell time as an implicit measure of usefulness in different task types , 2011, ASIST.

[56]  J H Wearden,et al.  Feeling the Heat: Body Temperature and the Rate of Subjective Time, Revisited , 1995, The Quarterly journal of experimental psychology. B, Comparative and physiological psychology.

[57]  Robert Rousseau,et al.  Interference from short-term memory processing on encoding and reproducing brief durations , 1998, Psychological research.

[58]  Fuchun Peng,et al.  Improving search relevance for implicitly temporal queries , 2009, SIGIR.

[59]  Chaoqun Ni,et al.  What Affects Word Changes in Query Reformulation During a Task-based Search Session? , 2016, CHIIR.

[60]  Tetsuya Sakai,et al.  TREC 2013 Temporal Summarization , 2013, TREC.

[61]  S. Droit-Volet,et al.  Emotion and Time Perception: Effects of Film-Induced Mood , 2011, Front. Integr. Neurosci..

[62]  Madalina Sucala,et al.  Psychological Time: Interval Length Judgments and Subjective Passage of Time Judgments , 2011 .

[63]  Leif Azzopardi,et al.  Time Pressure and System Delays in Information Search , 2015, SIGIR.