Mining touch interaction data on mobile devices to predict web search result relevance

Fine-grained search interactions in the desktop setting, such as mouse cursor movements and scrolling, have been shown valuable for understanding user intent, attention, and their preferences for Web search results. As web search on smart phones and tablets becomes increasingly popular, previously validated desktop interaction models have to be adapted for the available touch interactions such as pinching and swiping, and for the different device form factors. In this paper, we present, to our knowledge, the first in-depth study of modeling interactions on touch-enabled device for improving Web search ranking. In particular, we evaluate a variety of touch interactions on a smart phone as implicit relevance feedback, and compare them with the corresponding fine-grained interactions on a desktop computer with mouse and keyboard as the primary input devices. Our experiments are based on a dataset collected from two user studies with 56 users in total, using a specially instrumented version of a popular mobile browser to capture the interaction data. We report a detailed analysis of the similarities and differences of fine-grained search interactions between the desktop and the smart phone modalities, and identify novel patterns of touch interactions indicative of result relevance. Finally, we demonstrate significant improvements to search ranking quality by mining touch interaction data.

[1]  Ryen W. White,et al.  Improving searcher models using mouse cursor activity , 2012, SIGIR '12.

[2]  Qi Li,et al.  Personalized web exploration with task models , 2008, WWW.

[3]  Eugene Agichtein,et al.  Detecting success in mobile search from interaction , 2011, SIGIR '11.

[4]  Elizabeth F. Churchill,et al.  Mouse tracking: measuring and predicting users' experience of web-based content , 2012, CHI.

[5]  Steve Fox,et al.  Evaluating implicit measures to improve web search , 2005, TOIS.

[6]  Jaana Kekäläinen,et al.  IR evaluation methods for retrieving highly relevant documents , 2000, SIGIR '00.

[7]  Eugene Agichtein,et al.  Exploring mouse movements for inferring query intent , 2008, SIGIR '08.

[8]  Ryen W. White,et al.  Characterizing and predicting search engine switching behavior , 2009, CIKM.

[9]  Bill N. Schilit,et al.  From reading to retrieval: freeform ink annotations as queries , 1999, SIGIR '99.

[10]  James Allan,et al.  Predicting searcher frustration , 2010, SIGIR.

[11]  Filip Radlinski,et al.  Evaluating the accuracy of implicit feedback from clicks and query reformulations in Web search , 2007, TOIS.

[12]  Nicholas J. Belkin,et al.  Reading time, scrolling and interaction: exploring implicit sources of user preferences for relevance feedback , 2001, Annual International ACM SIGIR Conference on Research and Development in Information Retrieval.

[13]  Jeff Huang.  Web User Interaction Mining from Touch-Enabled Mobile Devices , 2012 .

[14]  Eugene Agichtein,et al.  Ready to buy or just browsing?: detecting web searcher goals from interaction data , 2010, SIGIR.

[15]  Ryen W. White,et al.  User see, user point: gaze and cursor alignment in web search , 2012, CHI.

[16]  Ryen W. White,et al.  Text selections as implicit relevance feedback , 2012, SIGIR '12.

[17]  Barry Smyth,et al.  Understanding the intent behind mobile information needs , 2009, IUI.

[18]  Susan T. Dumais,et al.  Improving Web Search Ranking by Incorporating User Behavior Information , 2019, SIGIR Forum.

[19]  Yoichi Shinoda,et al.  Information filtering based on user behavior analysis and best match text retrieval , 1994, SIGIR '94.

[20]  Eugene Agichtein,et al.  Towards predicting web searcher gaze position from mouse movements , 2010, CHI Extended Abstracts.

[21]  Ahmed Hassan Awadallah,et al.  Beyond DCG: user behavior as a predictor of a successful search , 2010, WSDM '10.

[22]  Ryen W. White,et al.  A study on the effects of personalization and task information on implicit feedback performance , 2006, CIKM '06.

[23]  Mark Claypool,et al.  Implicit interest indicators , 2001, IUI '01.

[24]  Ryen W. White,et al.  Discovering Hidden Contextual Factors for Implicit Feedback , 2007, CIR.

[25]  Ryen W. White,et al.  Large-scale analysis of individual and task differences in search result page examination strategies , 2012, WSDM '12.

[26]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[27]  Ya Xu,et al.  Computers and iphones and mobile phones, oh my!: a logs-based comparison of search users on different devices , 2009, WWW '09.

[28]  Yang Song,et al.  A Task Level User Satisfaction Metric and its Application on Improving Relevance Estimation , 2011 .

[29]  Ryen W. White,et al.  No clicks, no problem: using cursor movements to understand and improve search , 2011, CHI.

[30]  Nicholas J. Belkin,et al.  Display time as implicit feedback: understanding task effects , 2004, SIGIR '04.

[31]  Eugene Agichtein,et al.  Beyond dwell time: estimating document relevance from cursor movements and other post-click searcher behavior , 2012, WWW.

[32]  Andreas Dengel,et al.  Query expansion using gaze-based feedback on the subdocument level , 2008, SIGIR '08.

[33]  Nuria Oliver,et al.  Understanding mobile web and mobile search use in today's dynamic mobile landscape , 2011, Mobile HCI.

[34]  Andreas Dengel,et al.  Reading and estimating gaze on smart phones , 2012, ETRA '12.

[35]  Barry Smyth,et al.  Passive Profiling from Server Logs in an Online Recruitment Environment , 2001, IJCAI 2001.

[36]  Kerry Rodden,et al.  Eye-mouse coordination patterns on web search results pages , 2008, CHI Extended Abstracts.

[37]  Yang Song,et al.  A task level metric for measuring web search satisfaction and its application on improving relevance estimation , 2011, CIKM '11.