Why People Search for Images using Web Search Engines

What are the intents or goals behind human interactions with image search engines? Knowing why people search for images is of major concern to Web image search engines because user satisfaction may vary as intent varies. Previous analyses of image search behavior have mostly been query-based, focusing on what images people search for, rather than intent-based, that is, why people search for images. To date, there is no thorough investigation of how different image search intents affect users» search behavior. In this paper, we address the following questions: (1)Why do people search for images in text-based Web image search systems? (2)How does image search behavior change with user intent? (3)Can we predict user intent effectively from interactions during the early stages of a search session? To this end, we conduct both a lab-based user study and a commercial search log analysis. We show that user intents in image search can be grouped into three classes: Explore/Learn, Entertain, and Locate/Acquire. Our lab-based user study reveals different user behavior patterns under these three intents, such as first click time, query reformulation, dwell time and mouse movement on the result page. Based on user interaction features during the early stages of an image search session, that is, before mouse scroll, we develop an intent classifier that is able to achieve promising results for classifying intents into our three intent classes. Given that all features can be obtained online and unobtrusively, the predicted intents can provide guidance for choosing ranking methods immediately after scrolling.

[1]  Jing Wang,et al.  Clickage: towards bridging semantic and intent gaps via mining click logs of search engines , 2013, ACM Multimedia.

[2]  Yiqun Liu,et al.  Time-Aware Click Model , 2016, ACM Trans. Inf. Syst..

[3]  Rossano Schifanella,et al.  A Large-Scale Study of User Image Search Behavior on the Web , 2015, CHI.

[4]  Maarten de Rijke,et al.  Search behavior of media professionals at an audiovisual archive: A transaction log analysis , 2010, J. Assoc. Inf. Sci. Technol..

[5]  Tetsuya Sakai,et al.  Search Result Diversification Based on Hierarchical Intents , 2015, CIKM.

[6]  James Allan,et al.  Proceedings of the 2015 International Conference on The Theory of Information Retrieval , 2015, ICTIR.

[7]  Amanda Spink,et al.  Visual Information Seeking: A Study of Image Queries on the World Wide Web , 1999 .

[8]  Robin Jeffries,et al.  Task Behaviors During Web Search: The Difficulty of Assigning Labels , 2009, 2009 42nd Hawaii International Conference on System Sciences.

[9]  Jaime Arguello,et al.  Development and Evaluation of Search Tasks for IIR Experiments using a Cognitive Complexity Framework , 2015, ICTIR.

[10]  Gerhard Weikum,et al.  Gathering and ranking photos of named entities with high precision, high recall, and diversity , 2010, WSDM '10.

[11]  Maarten de Rijke,et al.  A Context-aware Time Model for Web Search , 2016, SIGIR.

[12]  I. Ajzen Perceived behavioral control, self-efficacy, locus of control, and the theory of planned behavior. , 2002 .

[13]  Ying Li,et al.  Detecting online commercial intention (OCI) , 2006, WWW '06.

[14]  Robin Jeffries,et al.  Task behaviors during web search: The difficulty of assigning labels , 2009 .

[15]  Meng Wang,et al.  Investigating Examination Behavior of Image Search Users , 2017, SIGIR.

[16]  Ximena Olivares,et al.  Visual diversification of image search results , 2009, WWW '09.

[17]  Bing Pan,et al.  The determinants of web page viewing behavior: an eye-tracking study , 2004, ETRA.

[18]  Amanda Spink,et al.  Real life, real users, and real needs: a study and analysis of user queries on the web , 2000, Inf. Process. Manag..

[19]  Vidit Jain,et al.  Learning to re-rank: query-dependent image re-ranking using click data , 2011, WWW.

[20]  Mathias Lux,et al.  Dynamic presentation adaptation based on user intent classification , 2009, MM '09.

[21]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[22]  W. Bruce Croft,et al.  Quary Expansion Using Local and Global Document Analysis , 1996, SIGIR Forum.

[23]  Enhong Chen,et al.  Context-aware query suggestion by mining click-through and session data , 2008, KDD.

[24]  Daniel E. Rose,et al.  Understanding user goals in web search , 2004, WWW '04.

[25]  Mohammad Soleymani,et al.  Multimodal Analysis of Image Search Intent: Intent Recognition in Image Search from User Behavior and Visual Content , 2017, ICMR.

[26]  Amanda Spink,et al.  A study and comparison of multimedia Web searching: 1997-2006 , 2009, J. Assoc. Inf. Sci. Technol..

[27]  Miriam Redi,et al.  Bridging the Aesthetic Gap: The Wild Beauty of Web Imagery , 2017, ICMR.

[28]  Hsiao-Tieh Pu,et al.  A comparative analysis of web image and textual queries , 2005, Online Inf. Rev..

[29]  Andrei Broder,et al.  A taxonomy of web search , 2002, SIGF.

[30]  Nick Craswell,et al.  An experimental comparison of click position-bias models , 2008, WSDM '08.

[31]  Rossano Schifanella,et al.  Leveraging User Interaction Signals for Web Image Search , 2016, SIGIR.

[32]  Xiaolong Li,et al.  Inferring search behaviors using partially observable Markov (POM) model , 2010, WSDM '10.

[33]  Ji-Rong Wen,et al.  WWW 2007 / Track: Search Session: Personalization A Largescale Evaluation and Analysis of Personalized Search Strategies ABSTRACT , 2022 .

[34]  W. Bruce Croft,et al.  Query expansion using local and global document analysis , 1996, SIGIR '96.

[35]  Desney S. Tan,et al.  Designing Novel Image Search Interfaces by Understanding Unique Characteristics and Usage , 2009, INTERACT.

[36]  Florence March,et al.  2016 , 2016, Affair of the Heart.

[37]  Pu-Jen Cheng,et al.  Learning user reformulation behavior for query auto-completion , 2014, SIGIR.

[38]  Krishna Bharat,et al.  Diversifying web search results , 2010, WWW '10.

[39]  Meng Wang,et al.  Visual query suggestion , 2010, ACM Trans. Multim. Comput. Commun. Appl..

[40]  Bernard J. Jansen Searching for digital images on the web , 2008, J. Documentation.

[41]  Mathias Lux,et al.  A classification scheme for user intentions in image search , 2010, CHI EA '10.

[42]  Peter L. Bartlett,et al.  Boosting Algorithms as Gradient Descent , 1999, NIPS.

[43]  Yiqun Liu,et al.  Incorporating revisiting behaviors into click models , 2012, WSDM '12.

[44]  Amanda Spink,et al.  Query Modifications Patterns During Web Searching , 2007, Fourth International Conference on Information Technology (ITNG'07).

[45]  Jure Leskovec,et al.  Predicting Intent Using Activity Logs: How Goal Specificity and Temporal Range Affect User Behavior , 2017, WWW.

[46]  J. Fleiss Measuring nominal scale agreement among many raters. , 1971 .

[47]  Hongbo Deng,et al.  A two-dimensional click model for query auto-completion , 2014, SIGIR.

[48]  Eric Brill,et al.  Improving web search ranking by incorporating user behavior information , 2006, SIGIR.

[49]  Mathias Lux,et al.  An Exploratory Study on the Explicitness of User Intentions in Digital Photo Retrieval , 2009 .

[50]  Jacek Gwizdka,et al.  Search behaviors in different task types , 2010, JCDL '10.