Situational Context for Ranking in Personal Search

Modern search engines leverage a variety of sources, beyond the conventional query-document content similarity, to improve their ranking performance. Among them, query context has attracted attention in prior work. Previously, query context was mainly modeled by user search history, either long-term or short-term, to help the ranking of future queries. In this paper, we focus on situational context, i.e., the contextual features of the current search request that are independent from both query content and user history. As an example, situational context can depend on search request time and location. We propose two context-aware ranking models based on neural networks. The first model learns a low-dimensional deep representation from the combination of contextual features. The second model extends the first one by leveraging binarized contextual features in addition to the high-level abstractions learned using a deep network. The existing context-aware ranking models are mainly based on search history, especially click data that can be gathered from the search engine logs. Although context-aware models have been widely explored in web search, their influence on search scenarios where click data is highly sparse is relatively unstudied. The focus of this paper, personal search (e.g., email search or on-device search), is one of such scenarios. We evaluate our models using the click data collected from one of the world's largest personal search engines. The experiments demonstrate that the proposed models significantly outperform the baselines which do not take context into account. These results indicate the importance of situational context for personal search, and open up a venue for further exploration of situational context in other search scenarios.

[1]  Susan T. Dumais,et al.  Stuff I've Seen: A System for Personal Information Retrieval and Re-Use , 2003, SIGF.

[2]  Hang Li,et al.  A Deep Architecture for Matching Short Texts , 2013, NIPS.

[3]  Enhong Chen,et al.  Context-aware ranking in web search , 2010, SIGIR '10.

[4]  Latanya Sweeney,et al.  k-Anonymity: A Model for Protecting Privacy , 2002, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[5]  Gilad Mishne,et al.  Mining rich session context to improve web search , 2009, KDD.

[6]  James P. Callan,et al.  Experiments with Language Models for Known-Item Finding of E-mail Messages , 2005, TREC.

[7]  Eugene Kharitonov,et al.  Demographic context in web search re-ranking , 2012, CIKM '12.

[8]  References , 1971 .

[9]  Martin Hacker,et al.  Understanding re-finding behavior in naturalistic email interaction logs , 2011, SIGIR '11.

[10]  Milad Shokouhi,et al.  Learning to personalize query auto-completion , 2013, SIGIR.

[11]  Marc Najork,et al.  Learning to Rank with Selection Bias in Personal Search , 2016, SIGIR.

[12]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[13]  Hang Li,et al.  Convolutional Neural Network Architectures for Matching Natural Language Sentences , 2014, NIPS.

[14]  Shumeet Baluja,et al.  The role of context in query input: using contextual signals to complete queries on mobile devices , 2007, Mobile HCI.

[15]  Pavel Serdyukov,et al.  Personalization of web-search using short-term browsing context , 2013, CIKM.

[16]  W. Bruce Croft,et al.  Estimating Embedding Vectors for Queries , 2016, ICTIR.

[17]  Thorsten Joachims,et al.  Optimizing search engines using clickthrough data , 2002, KDD.

[18]  Enhong Chen,et al.  Context-aware query suggestion by mining click-through and session data , 2008, KDD.

[19]  Enhong Chen,et al.  A vlHMM approach to context-aware search , 2013, TWEB.

[20]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[21]  W. Bruce Croft,et al.  End to End Long Short Term Memory Networks for Non-Factoid Question Answering , 2016, ICTIR.

[22]  Jian Pei,et al.  Mining search and browse logs for web search , 2013, ACM Trans. Intell. Syst. Technol..

[23]  Ryen W. White,et al.  Predicting short-term interests using activity-based search context , 2010, CIKM.

[24]  Thorsten Joachims,et al.  Accurately interpreting clickthrough data as implicit feedback , 2005, SIGIR '05.

[25]  Larry P. Heck,et al.  Learning deep structured semantic models for web search using clickthrough data , 2013, CIKM.

[26]  Susan T. Dumais,et al.  Improving Web Search Ranking by Incorporating User Behavior Information , 2019, SIGIR Forum.

[27]  Jianfeng Gao,et al.  Clickthrough-based latent semantic models for web search , 2011, SIGIR.

[28]  David Carmel,et al.  Rank by Time or by Relevance?: Revisiting Email Search , 2015, CIKM.

[29]  Nick Craswell,et al.  Query Expansion with Locally-Trained Word Embeddings , 2016, ACL.

[30]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[31]  James Allan,et al.  Predicting Search Intent Based on Pre-Search Context , 2015, SIGIR.

[32]  W. Bruce Croft,et al.  Embedding-based Query Language Models , 2016, ICTIR.

[33]  Wei Chu,et al.  Modeling the impact of short- and long-term behavior on search personalization , 2012, SIGIR '12.

[34]  Matt J. Kusner,et al.  From Word Embeddings To Document Distances , 2015, ICML.

[35]  Heng-Tze Cheng,et al.  Wide & Deep Learning for Recommender Systems , 2016, DLRS@RecSys.

[36]  M. de Rijke,et al.  A Neural Click Model for Web Search , 2016, WWW.

[37]  Ido Guy,et al.  Searching by Talking: Analysis of Voice Queries on Mobile Web Search , 2016, SIGIR.

[38]  Yoav Goldberg,et al.  A Primer on Neural Network Models for Natural Language Processing , 2015, J. Artif. Intell. Res..

[39]  Xuehua Shen,et al.  Context-sensitive information retrieval using implicit feedback , 2005, SIGIR '05.

[40]  Gleb Gusev,et al.  Engagement Periodicity in Search Engine Usage: Analysis and its Application to Search Quality Evaluation , 2015, WSDM.

[41]  Ya Xu,et al.  Computers and iphones and mobile phones, oh my!: a logs-based comparison of search users on different devices , 2009, WWW '09.

[42]  Filip Radlinski,et al.  Personalizing web search using long term browsing history , 2011, WSDM '11.

[43]  Marc Najork,et al.  Learning from User Interactions in Personal Search via Attribute Parameterization , 2017, WSDM.

[44]  M. de Rijke,et al.  Short Text Similarity with Word Embeddings , 2015, CIKM.

[45]  Yelong Shen,et al.  Learning semantic representations using convolutional neural networks for web search , 2014, WWW.

[46]  Ricardo Baeza-Yates,et al.  A Study of Mobile Search Queries in Japan , 2007 .

[47]  W. Bruce Croft,et al.  aNMM: Ranking Short Answer Texts with Attention-Based Neural Matching Model , 2016, CIKM.

[48]  W. Bruce Croft,et al.  Context-Based Topic Models for Query Modification , 2005 .

[49]  W. Bruce Croft,et al.  A Deep Relevance Matching Model for Ad-hoc Retrieval , 2016, CIKM.

[50]  Filip Radlinski,et al.  Inferring and using location metadata to personalize web search , 2011, SIGIR.

[51]  Enhong Chen,et al.  Context-aware query classification , 2009, SIGIR.