The Generalized Cascade Click Model: A Unified Framework for Estimating Click Models

Given the vital importance of search engines to find digital information, there has been much scientific attention on how users interact with search engines, and how such behavior can be modeled. Many models on user search engine interaction, which in the literature are known as click models, come in the form of Dynamic Bayesian Networks. Although many authors have used the resemblance between the different click models to derive estimation procedures for these models, in particular in the form of expectation maximization (EM), still this commonly requires considerable work, in particular when it comes to deriving the E-step. What we propose in this paper, is that this derivation is commonly unnecessary: many existing click models can in fact, under certain assumptions, be optimized as they were InputOutput Hidden Markov Models (IO-HMMs), for which the forward-backward equations immediately provide this E-step. To arrive at that conclusion, we will present the Generalized Cascade Model (GCM) and show how this model can be estimated using the IO-HMM EM framework, and provide two examples of how existing click models can be mapped to GCM. Our GCM approach to estimating click models has also been implemented in the gecasmo Python package.

[1]  Benjamin Piwowarski,et al.  A user browsing model to predict search engine click data from past observations. , 2008, SIGIR '08.

[2]  Detecting Users from Website Sessions: A Simulation Study , 2020 .

[3]  Stuart J. Russell,et al.  Dynamic bayesian networks: representation, inference and learning , 2002 .

[4]  Weiwei Deng,et al.  Ad Click Prediction in Sequence with Long Short-Term Memory Networks: an Externality-aware Model , 2018, SIGIR.

[5]  Thorsten Joachims,et al.  Accurately interpreting clickthrough data as implicit feedback , 2005, SIGIR '05.

[6]  Zhihua Zhang,et al.  Learning click models via probit bayesian inference , 2010, CIKM.

[7]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[8]  Olivier Chapelle,et al.  A dynamic bayesian network click model for web search ranking , 2009, WWW '09.

[9]  Yoshua Bengio,et al.  An Input Output HMM Architecture , 1994, NIPS.

[10]  Yiqun Liu,et al.  Time-Aware Click Model , 2016, ACM Trans. Inf. Syst..

[11]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[12]  Zheng Chen,et al.  A novel click model and its applications to online advertising , 2010, WSDM '10.

[13]  Chao Liu,et al.  Efficient multiple-click models in web search , 2009, WSDM '09.

[14]  M. de Rijke,et al.  Click Models for Web Search , 2015, Click Models for Web Search.

[15]  Andreas Krause,et al.  Advances in Neural Information Processing Systems (NIPS) , 2014 .

[16]  Nick Craswell,et al.  An experimental comparison of click position-bias models , 2008, WSDM '08.

[17]  Subbarao Kambhampati,et al.  Optimal Ad-Ranking for Profit Maximization , 2008, WebDB.

[18]  Yiqun Liu,et al.  Incorporating Non-sequential Behavior into Click Models , 2015, SIGIR.

[19]  M. de Rijke,et al.  A Click Sequence Model for Web Search , 2018, SIGIR.

[20]  ChengXiang Zhai,et al.  Content-aware click modeling , 2013, WWW '13.

[21]  Yuchen Zhang,et al.  User-click modeling for understanding and predicting search-behavior , 2011, KDD.

[22]  M. de Rijke,et al.  A Neural Click Model for Web Search , 2016, WWW.