Long Short-Term Session Search: Joint Personalized Reranking and Next Query Prediction

DR and next query prediction (NQP) are two core tasks in session search. They are often driven by the same search intent and, hence, it is natural to jointly optimize both tasks. So far, most models proposed for jointly optimizing document reranking (DR) and NQP have focused on users’ short-term intent in an ongoing search session. Because of this limitation, these models fail to account for users’ long-term intent as captured in their historical search sessions. In contrast, we consider a personalized mechanism for learning a user’s profile from their long-term and short-term behavior to simultaneously enhance the performance of DR and NQP in an ongoing search session. We propose a personalized session search model, called Long short-term session search, Network (LostNet), that jointly learns to rerank documents for the current query and predict the next query. LostNet consists of three modules: The hierarchical session-based attention mechanism tracks the fine-grained short-term intent in an ongoing session. The personalized multi-hop memory network tracks a user’s dynamic profile information from their prior search sessions so as to infer their personal search intent. Jointly learning of DR and NQP is aimed at simultaneously reranking documents and predicting the next query based on outputs from the above two modules. We conduct experiments on two large-scale session search benchmark datasets. The results show that LostNet achieves significant improvements over state-of-the-art baselines.

[1]  Md. Mustafizur Rahman,et al.  Neural information retrieval: at the end of the early years , 2017, Information Retrieval Journal.

[2]  Fabio Crestani,et al.  Towards query log based personalization using topic models , 2010, CIKM.

[3]  Zhiyuan Liu,et al.  Query Suggestion with Feedback Memory Network , 2018, WWW.

[4]  Ji-Rong Wen,et al.  Enhancing Re-finding Behavior with External Memories for Personalized Search , 2020, WSDM.

[5]  Ji-Rong Wen,et al.  Personalizing Search Results Using Hierarchical RNN with Query-aware Attention , 2018, CIKM.

[6]  Richard Socher,et al.  Ask Me Anything: Dynamic Memory Networks for Natural Language Processing , 2015, ICML.

[7]  Bamshad Mobasher,et al.  Web search personalization with ontological user profiles , 2007, CIKM '07.

[8]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[9]  Zhiyuan Liu,et al.  End-to-End Neural Ad-hoc Ranking with Kernel Pooling , 2017, SIGIR.

[10]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[11]  Wei Wang,et al.  RIN: Reformulation Inference Network for Context-Aware Query Suggestion , 2018, CIKM.

[12]  Wei Chu,et al.  Modeling the impact of short- and long-term behavior on search personalization , 2012, SIGIR '12.

[13]  Yelong Shen,et al.  A Latent Semantic Model with Convolutional-Pooling Structure for Information Retrieval , 2014, CIKM.

[14]  Xiaodong Liu,et al.  Representation Learning Using Multi-Task Deep Neural Networks for Semantic Classification and Information Retrieval , 2015, NAACL.

[15]  Wei Zhang,et al.  Improving Entity Recommendation with Search Log and Multi-Task Learning , 2018, IJCAI.

[16]  Rich Caruana,et al.  Multitask Learning , 1998, Encyclopedia of Machine Learning and Data Mining.

[17]  Rosie Jones,et al.  Beyond the session timeout: automatic hierarchical segmentation of search topics in query logs , 2008, CIKM '08.

[18]  Kai-Wei Chang,et al.  Multi-Task Learning for Document Ranking and Query Suggestion , 2018, International Conference on Learning Representations.

[19]  Wei Chu,et al.  Deep Learning Powered In-Session Contextual Ranking using Clickthrough Data , 2016 .

[20]  Abdur Chowdhury,et al.  A picture of search , 2006, InfoScale '06.

[21]  Kai-Wei Chang,et al.  Context Attentive Document Ranking and Query Suggestion , 2019, SIGIR.

[22]  M. de Rijke,et al.  A Collaborative Session-based Recommendation Approach with Parallel Memory Modules , 2019, SIGIR.

[23]  Nick Craswell,et al.  Learning to Match using Local and Distributed Representations of Text for Web Search , 2016, WWW.

[24]  Ricardo A. Baeza-Yates,et al.  Query Recommendation Using Query Logs in Search Engines , 2004, EDBT Workshops.

[25]  Jakob Grue Simonsen,et al.  A Hierarchical Recurrent Encoder-Decoder for Generative Context-Aware Query Suggestion , 2015, CIKM.

[26]  Ji-Rong Wen,et al.  WWW 2007 / Track: Search Session: Personalization A Largescale Evaluation and Analysis of Personalized Search Strategies ABSTRACT , 2022 .

[27]  Ji-Rong Wen,et al.  PSGAN: A Minimax Game for Personalized Search with Limited and Noisy Click Data , 2019, SIGIR.

[28]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[29]  Xueqi Cheng,et al.  Text Matching as Image Recognition , 2016, AAAI.

[30]  W. Bruce Croft,et al.  Search Engines - Information Retrieval in Practice , 2009 .

[31]  M. de Rijke,et al.  A Survey of Query Auto Completion in Information Retrieval , 2016, Found. Trends Inf. Retr..

[32]  Hang Li,et al.  Convolutional Neural Network Architectures for Matching Natural Language Sentences , 2014, NIPS.

[33]  Larry P. Heck,et al.  Learning deep structured semantic models for web search using clickthrough data , 2013, CIKM.

[34]  Ji-Rong Wen,et al.  Taxonomy-Aware Multi-Hop Reasoning Networks for Sequential Recommendation , 2019, WSDM.

[35]  M. de Rijke,et al.  Attention-based Hierarchical Neural Query Suggestion , 2018, SIGIR.

[36]  Enrique Alfonseca,et al.  Learning to Attend, Copy, and Generate for Session-Based Query Suggestion , 2017, CIKM.

[37]  Dawei Song,et al.  Temporal Latent Topic User Profiles for Search Personalisation , 2015, ECIR.

[38]  Jun Zhao,et al.  Inner Attention based Recurrent Neural Networks for Answer Selection , 2016, ACL.

[39]  Jason Weston,et al.  Learning End-to-End Goal-Oriented Dialog , 2016, ICLR.

[40]  Bhaskar Mitra,et al.  An Introduction to Neural Information Retrieval , 2018, Found. Trends Inf. Retr..

[41]  Yiqun Liu,et al.  How do users describe their information need: Query recommendation based on snippet click model , 2011, Expert Syst. Appl..

[42]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[43]  Bhaskar Mitra,et al.  Exploring Session Context using Distributed Representations of Queries and Reformulations , 2015, SIGIR.

[44]  Bin Shen,et al.  Collaborative Memory Network for Recommendation Systems , 2018, SIGIR.

[45]  Salim Roukos,et al.  Bleu: a Method for Automatic Evaluation of Machine Translation , 2002, ACL.

[46]  Yiqun Liu,et al.  Identifying Web Spam with the Wisdom of the Crowds , 2012, TWEB.

[47]  Christopher D. Manning,et al.  Effective Approaches to Attention-based Neural Machine Translation , 2015, EMNLP.

[48]  Hang Li,et al.  Semantic Matching in Search , 2014, SMIR@SIGIR.

[49]  M. de Rijke,et al.  Time-sensitive Personalized Query Auto-Completion , 2014, CIKM.

[50]  Hugo Zaragoza,et al.  The Probabilistic Relevance Framework: BM25 and Beyond , 2009, Found. Trends Inf. Retr..

[51]  Jaime Teevan,et al.  Understanding and predicting personal navigation , 2011, WSDM '11.

[52]  W. Bruce Croft,et al.  A Deep Relevance Matching Model for Ad-hoc Retrieval , 2016, CIKM.

[53]  Jason Weston,et al.  End-To-End Memory Networks , 2015, NIPS.

[54]  Eric K. Ringger,et al.  Match-Tensor: a Deep Relevance Model for Search , 2017, ArXiv.

[55]  Yang Song,et al.  Adapting deep RankNet for personalized search , 2014, WSDM.

[56]  Amanda Spink,et al.  Defining a session on Web search engines: Research Articles , 2007 .

[57]  Yongfeng Zhang,et al.  Sequential Recommendation with User Memory Networks , 2018, WSDM.