The Influence of Image Search Intents on User Behavior and Satisfaction

Understanding search intents behind queries is of vital importance for improving search performance or designing better evaluation metrics. Although there exist many efforts in Web search user intent taxonomies and investigating how users' interaction behaviors vary with the intent types, only a few of them have been made specifically for the image search scenario. Different from previous works which investigate image search user behavior and task characteristics based on either lab studies or large scale log analysis, we conducted a field study which lasts one month and involves 2,040 search queries from 555 search tasks. By this means, we collected relatively large amount of practical search behavior data with extensive first-tier annotation from users. With this data set, we investigate how various image search intents affect users' search behavior, and try to adopt different signals to predict search satisfaction under the certain intent. Meanwhile, external assessors were also employed to categorize each search task using four orthogonal intent taxonomies. Based on the hypothesis that behavior is dependent of task type, we analyze user search behavior on the field study data, examining characteristics of the session, click and mouse patterns. We also link the search satisfaction prediction to image search intent, which shows that different types of signals play different roles in satisfaction prediction as intent varies. Our findings indicate the importance of considering search intent in user behavior analysis and satisfaction prediction in image search.

[1]  Martha Larson,et al.  Intent and its discontents: the user at the wheel of the online video search engine , 2012, ACM Multimedia.

[2]  Kalervo Järvelin,et al.  Task complexity affects information seeking and use , 1995 .

[3]  Chirag Shah,et al.  Exploring the relationships between search intentions and query reformulations , 2016, ASIST.

[4]  Brian D. Davison,et al.  Measuring and Predicting Search Engine Users’ Satisfaction , 2016, ACM Comput. Surv..

[5]  Ahmed Hassan Awadallah A semi-supervised approach to modeling web search satisfaction , 2012 .

[6]  Diane Kelly,et al.  Methods for Evaluating Interactive Information Retrieval Systems with Users , 2009, Found. Trends Inf. Retr..

[7]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[8]  Robin Jeffries,et al.  Task Behaviors During Web Search: The Difficulty of Assigning Labels , 2009, 2009 42nd Hawaii International Conference on System Sciences.

[9]  Pertti Vakkari,et al.  Changes of search terms and tactics while writing a research proposal: A longitudinal case study , 2003, Inf. Process. Manag..

[10]  Meng Wang,et al.  Investigating Examination Behavior of Image Search Users , 2017, SIGIR.

[11]  David M. Nichols,et al.  How people find videos , 2008, JCDL '08.

[12]  Yiqun Liu,et al.  A Study of User Image Search Behavior Based on Log Analysis , 2017, CCIR.

[13]  Chirag Shah,et al.  Predicting Information Seeking Intentions from Search Behaviors , 2017, SIGIR.

[14]  Ricardo A. Baeza-Yates,et al.  The Intention Behind Web Queries , 2006, SPIRE.

[15]  Yiqun Liu,et al.  Why People Search for Images using Web Search Engines , 2017, WSDM.

[16]  Nick Craswell,et al.  Beyond clicks: query reformulation as a predictor of search satisfaction , 2013, CIKM.

[17]  Hsiao-Tieh Pu,et al.  A comparative analysis of web image and textual queries , 2005, Online Inf. Rev..

[18]  Eugene Agichtein,et al.  Predicting web search success with fine-grained interaction data , 2012, CIKM.

[19]  Peter Ingwersen,et al.  The Turn - Integration of Information Seeking and Retrieval in Context , 2005, The Kluwer International Series on Information Retrieval.

[20]  Nicholas J. Belkin,et al.  A faceted approach to conceptualizing tasks in information seeking , 2008, Inf. Process. Manag..

[21]  Fan Zhang,et al.  How Well do Offline and Online Evaluation Metrics Measure User Satisfaction in Web Image Search? , 2018, SIGIR.

[22]  Andrei Broder,et al.  A taxonomy of web search , 2002, SIGF.

[23]  Ryen W. White,et al.  Comparing client and server dwell time estimates for click-level satisfaction prediction , 2014, SIGIR.

[24]  J. Fleiss Measuring nominal scale agreement among many raters. , 1971 .

[25]  Yiqun Liu,et al.  When does Relevance Mean Usefulness and User Satisfaction in Web Search? , 2016, SIGIR.

[26]  Martha Larson,et al.  User Intent in Multimedia Search , 2016, ACM Comput. Surv..

[27]  Emine Yilmaz,et al.  User Behaviour and Task Characteristics: A Field Study of Daily Information Behaviour , 2017, CHIIR.

[28]  Tie-Yan Liu,et al.  Actively predicting diverse search intent from user browsing behaviors , 2010, WWW '10.

[29]  Yiqun Liu,et al.  Different Users, Different Opinions: Predicting Search Satisfaction with Mouse Movement Information , 2015, SIGIR.

[30]  Desney S. Tan,et al.  Designing Novel Image Search Interfaces by Understanding Unique Characteristics and Usage , 2009, INTERACT.

[31]  Ahmed Hassan Awadallah,et al.  Beyond DCG: user behavior as a predictor of a successful search , 2010, WSDM '10.

[32]  Ryen W. White,et al.  A study on the effects of personalization and task information on implicit feedback performance , 2006, CIKM '06.

[33]  Daniel E. Rose,et al.  Understanding user goals in web search , 2004, WWW '04.

[34]  Rossano Schifanella,et al.  A Large-Scale Study of User Image Search Behavior on the Web , 2015, CHI.

[35]  Hong Xie,et al.  Planned and Situated Aspects in Interactive IR: Patterns of User Interactive Intentions and Information Seeking Strategies , 1997 .

[36]  Mathias Lux,et al.  A classification scheme for user intentions in image search , 2010, CHI EA '10.

[37]  Eddy Maddalena,et al.  On Fine-Grained Relevance Scales , 2018, SIGIR.

[38]  Peter L. Bartlett,et al.  Boosting Algorithms as Gradient Descent , 1999, NIPS.

[39]  Mathias Lux,et al.  What Makes People Watch Online Videos , 2017, Comput. Entertain..

[40]  T. Foulsham,et al.  Quarterly Journal of Experimental Psychology: in press Visual saliency and semantic incongruency influence eye movements when , 2022 .

[41]  Bernard J. Jansen Searching for digital images on the web , 2008, J. Documentation.

[42]  Rossano Schifanella,et al.  Leveraging User Interaction Signals for Web Image Search , 2016, SIGIR.