A Graph-Enhanced Click Model for Web Search

To better exploit search logs and model users' behavior patterns, numerous click models are proposed to extract users' implicit interaction feedback. Most traditional click models are based on the probabilistic graphical model (PGM) framework, which requires manually designed dependencies and may oversimplify user behaviors. Recently, methods based on neural networks are proposed to improve the prediction accuracy of user behaviors by enhancing the expressive ability and allowing flexible dependencies. However, they still suffer from the data sparsity and cold-start problems. In this paper, we propose a novel graph-enhanced click model (GraphCM) for web search. Firstly, we regard each query or document as a vertex, and propose novel homogeneous graph construction methods for queries and documents respectively, to fully exploit both intra-session and inter-session information for the sparsity and cold-start problems. Secondly, following the examination hypothesis, we separately model the attractiveness estimator and examination predictor to output the attractiveness scores and examination probabilities, where graph neural networks and neighbor interaction techniques are applied to extract the auxiliary information encoded in the pre-constructed homogeneous graphs. Finally, we apply combination functions to integrate examination probabilities and attractiveness scores into click predictions. Extensive experiments conducted on three real-world session datasets show that GraphCM not only outperforms the state-of-art models, but also achieves superior performance in addressing the data sparsity and cold-start problems.

[1]  Jure Leskovec,et al.  Inductive Representation Learning on Large Graphs , 2017, NIPS.

[2]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[3]  Chao Liu,et al.  Efficient multiple-click models in web search , 2009, WSDM '09.

[4]  Wenwu Zhu,et al.  Structural Deep Network Embedding , 2016, KDD.

[5]  Benjamin Piwowarski,et al.  A user browsing model to predict search engine click data from past observations. , 2008, SIGIR '08.

[6]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[7]  Nick Craswell,et al.  An experimental comparison of click position-bias models , 2008, WSDM '08.

[8]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[9]  ChengXiang Zhai,et al.  Content-aware click modeling , 2013, WWW '13.

[10]  Daniel R. Figueiredo,et al.  struc2vec: Learning Node Representations from Structural Identity , 2017, KDD.

[11]  Gary Marchionini,et al.  Synthesis Lectures on Information Concepts, Retrieval, and Services , 2009 .

[12]  Weinan Zhang,et al.  An end-to-end neighborhood-based interaction model for knowledge-enhanced recommendation , 2019, Proceedings of the 1st International Workshop on Deep Learning Practice for High-Dimensional Sparse Data.

[13]  M. de Rijke,et al.  A Click Sequence Model for Web Search , 2018, SIGIR.

[14]  Jure Leskovec,et al.  Graph Convolutional Neural Networks for Web-Scale Recommender Systems , 2018, KDD.

[15]  Zheng Chen,et al.  A novel click model and its applications to online advertising , 2010, WSDM '10.

[16]  Yixin Cao,et al.  KGAT: Knowledge Graph Attention Network for Recommendation , 2019, KDD.

[17]  Chao Liu,et al.  Click chain model in web search , 2009, WWW '09.

[18]  Yiqun Liu,et al.  TianGong-ST: A New Dataset with Large-scale Refined Real-world Web Search Sessions , 2019, CIKM.

[19]  M. de Rijke,et al.  A Neural Click Model for Web Search , 2016, WWW.

[20]  Nitesh V. Chawla,et al.  Heterogeneous Graph Neural Network , 2019, KDD.

[21]  Jaana Kekäläinen,et al.  IR evaluation methods for retrieving highly relevant documents , 2000, SIGIR Forum.

[22]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[23]  Jia Chen Beyond Sessions: Exploiting Hybrid Contextual Information for Web Search , 2020, WSDM.

[24]  Yiqun Liu,et al.  Incorporating revisiting behaviors into click models , 2012, WSDM '12.

[25]  JärvelinKalervo,et al.  IR evaluation methods for retrieving highly relevant documents , 2017 .

[26]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[27]  Matthew Richardson,et al.  Predicting clicks: estimating the click-through rate for new ads , 2007, WWW '07.

[28]  M. de Rijke,et al.  Click Models for Web Search , 2015, Click Models for Web Search.

[29]  Yiqun Liu,et al.  A Context-Aware Click Model for Web Search , 2020, WSDM.

[30]  Yuchen Zhang,et al.  User-click modeling for understanding and predicting search-behavior , 2011, KDD.

[31]  Yuchen Zhang,et al.  Incorporating post-click behaviors into a click model , 2010, SIGIR.

[32]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[33]  Olivier Chapelle,et al.  A dynamic bayesian network click model for web search ranking , 2009, WWW '09.

[34]  Max Welling,et al.  Graph Convolutional Matrix Completion , 2017, ArXiv.