Modeling the impact of short- and long-term behavior on search personalization

User behavior provides many cues to improve the relevance of search results through personalization. One aspect of user behavior that provides especially strong signals for delivering better relevance is an individual's history of queries and clicked documents. Previous studies have explored how short-term behavior or long-term behavior can be predictive of relevance. Ours is the first study to assess how short-term (session) behavior and long-term (historic) behavior interact, and how each may be used in isolation or in combination to optimally contribute to gains in relevance through search personalization. Our key findings include: historic behavior provides substantial benefits at the start of a search session; short-term session behavior contributes the majority of gains in an extended search session; and the combination of session and historic behavior out-performs using either alone. We also characterize how the relative contribution of each model changes throughout the duration of a session. Our findings have implications for the design of search systems that leverage user behavior to personalize the search experience.

[1]  Alexander Pretschner,et al.  Ontology-based personalized search and browsing , 2003, Web Intell. Agent Syst..

[2]  Doug Downey,et al.  Understanding the relationship between searchers' queries and information goals , 2008, CIKM '08.

[3]  Ji-Rong Wen,et al.  WWW 2007 / Track: Search Session: Personalization A Largescale Evaluation and Analysis of Personalized Search Strategies ABSTRACT , 2022 .

[4]  Benjamin Piwowarski,et al.  Predictive user click models based on click-through history , 2007, CIKM '07.

[5]  Paul D. Clough,et al.  Session Track Overview ∗ , 2010 .

[6]  Quoc V. Le,et al.  Learning to Rank with Non-Smooth Cost Functions , 2007 .

[7]  Susan T. Dumais,et al.  Analysis of topic dynamics in web search , 2005, WWW '05.

[8]  Susan T. Dumais,et al.  Classification-enhanced ranking , 2010, WWW '10.

[9]  Raymond J. Mooney,et al.  Learning to Disambiguate Search Queries from Short Sessions , 2009, ECML/PKDD.

[10]  Ryen W. White,et al.  Personalizing web search results by reading level , 2011, CIKM '11.

[11]  Jaime Teevan,et al.  Understanding and predicting personal navigation , 2011, WSDM '11.

[12]  Mohand Boughanem,et al.  A session based personalized search using an ontological user profile , 2009, SAC '09.

[13]  Enhong Chen,et al.  Context-aware ranking in web search , 2010, SIGIR '10.

[14]  Filip Radlinski,et al.  Personalizing web search using long term browsing history , 2011, WSDM '11.

[15]  Yuchen Zhang,et al.  Incorporating post-click behaviors into a click model , 2010, SIGIR.

[16]  Wei Yuan,et al.  Smoothing clickthrough data for web search ranking , 2009, SIGIR.

[17]  Rosie Jones,et al.  Beyond the session timeout: automatic hierarchical segmentation of search topics in query logs , 2008, CIKM '08.

[18]  Wolfgang Nejdl,et al.  Using ODP metadata to personalize search , 2005, SIGIR '05.

[19]  Ryen W. White,et al.  Predicting short-term interests using activity-based search context , 2010, CIKM.

[20]  Enhong Chen,et al.  Context-aware query suggestion by mining click-through and session data , 2008, KDD.

[21]  Zhenglu Yang,et al.  Dynamic Adaptation Strategies for Long-Term and Short-Term User Profile to Personalize Search , 2007, APWeb/WAIM.

[22]  Olivia R. Liu Sheng,et al.  Interest-based personalized search , 2007, TOIS.

[23]  Ryen W. White,et al.  WWW 2007 / Track: Browsers and User Interfaces Session: Personalization Investigating Behavioral Variability in Web Search , 2022 .

[24]  Hsuan-Tien Lin,et al.  An Ensemble Ranking Solution for the Yahoo ! Learning to Rank Challenge , 2010 .

[25]  Ryen W. White,et al.  Predicting user interests from contextual information , 2009, SIGIR.

[26]  Jianfeng Gao,et al.  Ranking, Boosting, and Model Adaptation , 2008 .

[27]  ChengXiang Zhai,et al.  Mining long-term search history to improve search accuracy , 2006, KDD '06.

[28]  Ben Carterette,et al.  Overview of the TREC 2010 Session Track , 2010, TREC.

[29]  Susan Gauch,et al.  Personalizing Search Based on User Search Histories , 2004 .

[30]  Alexander Pretschner,et al.  Ontology-Based User Profiles for Search and Browsing , 2002 .

[31]  Filip Radlinski,et al.  Inferring and using location metadata to personalize web search , 2011, SIGIR.

[32]  Enhong Chen,et al.  Context-aware query classification , 2009, SIGIR.

[33]  Susan T. Dumais,et al.  To personalize or not to personalize: modeling queries with variation in user intent , 2008, SIGIR '08.

[34]  Steve Fox,et al.  Evaluating implicit measures to improve web search , 2005, TOIS.

[35]  Ryen W. White,et al.  Probabilistic models for personalizing web search , 2012, WSDM '12.

[36]  Susan T. Dumais,et al.  Personalizing Search via Automated Analysis of Interests and Activities , 2005, SIGIR.

[37]  Xuehua Shen,et al.  Context-sensitive information retrieval using implicit feedback , 2005, SIGIR '05.

[38]  Masatoshi Yoshikawa,et al.  Adaptive web search based on user profile constructed without any effort from users , 2004, WWW '04.

[39]  Ryen W. White,et al.  Modeling and analysis of cross-session search tasks , 2011, SIGIR.