A Capsule Network-based Embedding Model for Search Personalization

Search personalization aims to tailor search results to each specific user based on the user's personal interests and preferences (i.e., the user profile). Recent research approaches to search personalization by modelling the potential 3-way relationship between the submitted query, the user and the search results (i.e., documents). That relationship is then used to personalize the search results to that user. In this paper, we introduce a novel embedding model based on capsule network, which recently is a breakthrough in deep learning, to model the 3-way relationships for search personalization. In the model, each user (submitted query or returned document) is embedded by a vector in the same vector space. The 3-way relationship is described as a triple of (query, user, document) which is then modeled as a 3-column matrix containing the three embedding vectors. After that, the 3-column matrix is fed into a deep learning architecture to re-rank the search results returned by a basis ranker. Experimental results on query logs from a commercial web search engine show that our model achieves better performances than the basis ranker as well as strong search personalization baselines.

[1]  Meredith Ringel Morris,et al.  Discovering and using groups to improve personalized search , 2009, WSDM '09.

[2]  Manolis Vavalis,et al.  A network-based model for high-dimensional information filtering , 2010, SIGIR '10.

[3]  Fabio Crestani,et al.  Building user profiles from topic models for personalised search , 2013, CIKM.

[4]  Susan T. Dumais,et al.  Personalizing Search via Automated Analysis of Interests and Activities , 2005, SIGIR.

[5]  Dat Quoc Nguyen,et al.  Search Personalization with Embeddings , 2017, ECIR.

[6]  Ji-Rong Wen,et al.  A large-scale evaluation and analysis of personalized search strategies , 2007, WWW '07.

[7]  Xin Liu,et al.  Modeling Users' Dynamic Preference for Personalized Recommendation , 2015, IJCAI.

[8]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[9]  Steve Fox,et al.  Evaluating implicit measures to improve web search , 2005, TOIS.

[10]  Dawei Song,et al.  Temporal Latent Topic User Profiles for Search Personalisation , 2015, ECIR.

[11]  Geoffrey E. Hinton,et al.  Dynamic Routing Between Capsules , 2017, NIPS.

[12]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[13]  Udo Kruschwitz,et al.  Personalised Query Suggestion for Intranet Search with Temporal User Profiling , 2017, CHIIR.

[14]  Steven C. H. Hoi,et al.  On Effective Personalized Music Retrieval by Exploring Online User Behaviors , 2016, SIGIR.

[15]  M. de Rijke,et al.  Behavior‐based personalization in web search , 2017, J. Assoc. Inf. Sci. Technol..

[16]  Milad Shokouhi,et al.  Modeling User Interests for Zero-Query Ranking , 2016, ECIR.

[17]  Christopher D. Manning,et al.  Introduction to Information Retrieval , 2010, J. Assoc. Inf. Sci. Technol..

[18]  Jaime Teevan,et al.  Understanding and predicting personal navigation , 2011, WSDM '11.

[19]  Mihajlo Grbovic,et al.  Search Ranking And Personalization at Airbnb , 2017, RecSys.

[20]  Wei Chu,et al.  Modeling the impact of short- and long-term behavior on search personalization , 2012, SIGIR '12.

[21]  Wei Chu,et al.  Enhancing personalized search by mining and modeling task behavior , 2013, WWW.