Learning Multi-touch Conversion Attribution with Dual-attention Mechanisms for Online Advertising

In online advertising, the Internet users may be exposed to a sequence of different ad campaigns, i.e., display ads, search, or referrals from multiple channels, before led up to any final sales conversion and transaction. For both campaigners and publishers, it is fundamentally critical to estimate the contribution from ad campaign touch-points during the customer journey (conversion funnel) and assign the right credit to the right ad exposure accordingly. However, the existing research on the multi-touch attribution problem lacks a principled way of utilizing the users' pre-conversion actions (i.e., clicks), and quite often fails to model the sequential patterns among the touch points from a user's behavior data. To make it worse, the current industry practice is merely employing a set of arbitrary rules as the attribution model, e.g., the popular last-touch model assigns 100% credit to the final touch-point regardless of actual attributions. In this paper, we propose a Dual-attention Recurrent Neural Network (DARNN) for the multi-touch attribution problem. It learns the attribution values through an attention mechanism directly from the conversion estimation objective. To achieve this, we utilize sequence-to-sequence prediction for user clicks, and combine both post-view and post-click attribution patterns together for the final conversion estimation. To quantitatively benchmark attribution models, we also propose a novel yet practical attribution evaluation scheme through the proxy of budget allocation (under the estimated attributions) over ad channels. The experimental results on two real datasets demonstrate the significant performance gains of our attribution model against the state of the art.

[1]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[2]  Lars Schmidt-Thieme,et al.  Factorizing personalized Markov chains for next-basket recommendation , 2010, WWW '10.

[3]  Lexin Li,et al.  Data-driven multi-touch attribution models , 2011, KDD.

[4]  Foster Provost,et al.  Causally motivated attribution for online advertising , 2012, ADKDD '12.

[5]  Wentong Li,et al.  Estimating conversion rate in display advertising from past erformance data , 2012, KDD.

[6]  Anton Schwaighofer,et al.  Budget Optimization for Sponsored Search: Censored Learning in MDPs , 2012, UAI.

[7]  Foster J. Provost,et al.  Bid optimizing and inventory scoring in targeted online advertising , 2012, KDD.

[8]  Ali Jalali,et al.  Real time bid optimization with smooth budget delivery in online advertising , 2013, ADKDD '13.

[9]  Martin Wattenberg,et al.  Ad click prediction: a view from the trenches , 2013, KDD.

[10]  Ya Zhang,et al.  Multi-touch Attribution in Online Advertising with Survival Theory , 2014, 2014 IEEE International Conference on Data Mining.

[11]  Tie-Yan Liu,et al.  Sequential Click Prediction for Sponsored Search with Recurrent Neural Networks , 2014, AAAI.

[12]  Shiv Kumar Saini,et al.  Estimating the incremental effects of interactions for marketing attribution , 2014, 2014 International Conference on Behavioral, Economic, and Socio-Cultural Computing (BESC2014).

[13]  Sahin Cem Geyik,et al.  Multi-Touch Attribution Based Budget Allocation in Online Advertising , 2014, ADKDD'14.

[14]  Souvik Ghosh,et al.  Budget pacing for targeted online advertisements at LinkedIn , 2014, KDD.

[15]  Andrew B. Whinston,et al.  Path to Purchase: A Mutually Exciting Point Process Model for Online Advertising and Conversion , 2012, Manag. Sci..

[16]  Weinan Zhang,et al.  Optimal real-time bidding for display advertising , 2014, KDD.

[17]  Hongyuan Zha,et al.  On Machine Learning towards Predictive Sales Pipeline Analytics , 2015, AAAI.

[18]  Shuai Yuan,et al.  Supply side optimisation in online display advertising , 2015 .

[19]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[20]  Jun Wang,et al.  Deep Learning over Multi-field Categorical Data - - A Case Study on User Response Prediction , 2016, ECIR.

[21]  Jun Wang,et al.  Product-Based Neural Networks for User Response Prediction , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[22]  Zhongfei Zhang,et al.  DeepIntent: Learning Attentions for Online Advertising with Recurrent Neural Networks , 2016, KDD.

[23]  Jun Wang,et al.  User Response Learning for Directly Optimizing Campaign Performance in Display Advertising , 2016, CIKM.

[24]  Jian Xu,et al.  Lift-Based Bidding in Ad Selection , 2016, AAAI.

[25]  Xiaoling Wang,et al.  A Probabilistic Multi-Touch Attribution Model for Online Advertising , 2016, CIKM.

[26]  Yann Dauphin,et al.  Convolutional Sequence to Sequence Learning , 2017, ICML.

[27]  Garrison W. Cottrell,et al.  A Dual-Stage Attention-Based Recurrent Neural Network for Time Series Prediction , 2017, IJCAI.

[28]  Tong Zhang,et al.  Hierarchical Contextual Attention Recurrent Neural Network for Map Query Suggestion , 2017, IEEE Transactions on Knowledge and Data Engineering.

[29]  Eustache Diemert,et al.  Attribution Modeling Increases Efficiency of Bidding in Display Advertising , 2017, ADKDD@KDD.

[30]  Jun Wang,et al.  Display Advertising with Real-Time Bidding (RTB) and Behavioural Targeting , 2016, Found. Trends Inf. Retr..

[31]  Xiaoling Wang,et al.  Additional Multi-Touch Attribution for Online Advertising , 2017, AAAI.

[32]  Lantao Yu,et al.  Dynamic Attention Deep Model for Article Recommendation by Learning Human Editors' Demonstration , 2017, KDD.

[33]  Xiao Ma,et al.  Entire Space Multi-Task Model: An Effective Approach for Estimating Post-Click Conversion Rate , 2018, SIGIR.

[34]  Yong Yu,et al.  Neural Link Prediction over Aligned Networks , 2018, AAAI.

[35]  Ron Berman,et al.  Beyond the Last Touch: Attribution in Online Advertising , 2018, Mark. Sci..

[36]  Weinan Zhang,et al.  Bidding Machine: Learning to Bid for Directly Optimizing Profits in Display Advertising , 2018, IEEE Transactions on Knowledge and Data Engineering.