Deep Landscape Forecasting for Real-time Bidding Advertising

The emergence of real-time auction in online advertising has drawn huge attention of modeling the market competition, i.e., bid landscape forecasting. The problem is formulated as to forecast the probability distribution of market price for each ad auction. With the consideration of the censorship issue which is caused by the second-price auction mechanism, many researchers have devoted their efforts on bid landscape forecasting by incorporating survival analysis from medical research field. However, most existing solutions mainly focus on either counting-based statistics of the segmented sample clusters, or learning a parameterized model based on some heuristic assumptions of distribution forms. Moreover, they neither consider the sequential patterns of the feature over the price space. In order to capture more sophisticated yet flexible patterns at fine-grained level of the data, we propose a Deep Landscape Forecasting (DLF) model which combines deep learning for probability distribution forecasting and survival analysis for censorship handling. Specifically, we utilize a recurrent neural network to flexibly model the conditional winning probability w.r.t. each bid price. Then we conduct the bid landscape forecasting through probability chain rule with strict mathematical derivations. And, in an end-to-end manner, we optimize the model by minimizing two negative likelihood losses with comprehensive motivations. Without any specific assumption for the distribution form of bid landscape, our model shows great advantages over previous works on fitting various sophisticated market price distributions. In the experiments over two large-scale real-world datasets, our model significantly outperforms the state-of-the-art solutions under various metrics.

[1]  Tie-Yan Liu,et al.  Sequential Click Prediction for Sponsored Search with Recurrent Neural Networks , 2014, AAAI.

[2]  S. Muthukrishnan,et al.  Ad Exchanges: Research Issues , 2009, WINE.

[3]  Jun Wang,et al.  Bid-aware Gradient Descent for Unbiased Learning with Censored Data in Display Advertising , 2016, KDD.

[4]  Weinan Zhang,et al.  Bidding Machine: Learning to Bid for Directly Optimizing Profits in Display Advertising , 2018, IEEE Transactions on Knowledge and Data Engineering.

[5]  Anton Schwaighofer,et al.  Budget Optimization for Sponsored Search: Censored Learning in MDPs , 2012, UAI.

[6]  Xuehua Shen,et al.  iPinYou Global RTB Bidding Algorithm Competition Dataset , 2014, ADKDD'14.

[7]  Adler J. Perotte,et al.  Deep Survival Analysis , 2016, MLHC.

[8]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[9]  Gang Chen,et al.  Personal recommendation using deep recurrent neural networks in NetEase , 2016, 2016 IEEE 32nd International Conference on Data Engineering (ICDE).

[10]  D.,et al.  Regression Models and Life-Tables , 2022 .

[11]  Bhaskar Bhattacharya,et al.  Median of the p Value Under the Alternative Hypothesis , 2002 .

[12]  Yoshua Bengio,et al.  Deep Learning for Patient-Specific Kidney Graft Survival Analysis , 2017, ArXiv.

[13]  Jun Wang,et al.  Real-Time Bidding Benchmarking with iPinYou Dataset , 2014, ArXiv.

[14]  E. Kaplan,et al.  Nonparametric Estimation from Incomplete Observations , 1958 .

[15]  Elisa Lee,et al.  Statistical Methods for Survival Data Analysis: Lee/Survival Data Analysis , 2003 .

[16]  Changhee Lee,et al.  DeepHit: A Deep Learning Approach to Survival Analysis With Competing Risks , 2018, AAAI.

[17]  Uri Shaham,et al.  DeepSurv: personalized treatment recommender system using a Cox proportional hazards deep neural network , 2016, BMC Medical Research Methodology.

[18]  Gongshen Liu,et al.  Sliced Recurrent Neural Networks , 2018, COLING.

[19]  Chang Zhou,et al.  Deep Interest Evolution Network for Click-Through Rate Prediction , 2018, AAAI.

[20]  R. Olshen,et al.  Tree-structured survival analysis. , 1985, Cancer treatment reports.

[21]  Yang Jing L1 Regularization Path Algorithm for Generalized Linear Models , 2008 .

[22]  Jun Wang,et al.  Real-time bidding for online advertising: measurement and analysis , 2013, ADKDD '13.

[23]  Eustache Diemert,et al.  Attribution Modeling Increases Efficiency of Bidding in Display Advertising , 2017, ADKDD@KDD.

[24]  Ming-Syan Chen,et al.  Predicting Winning Price in Real Time Bidding with Censored Data , 2015, KDD.

[25]  Wei Li,et al.  Bid landscape forecasting in online ad exchange marketplace , 2011, KDD.

[26]  F. Harrell,et al.  Regression modelling strategies for improved prognostic prediction. , 1984, Statistics in medicine.

[27]  Hao Helen Zhang,et al.  Adaptive Lasso for Cox's proportional hazards model , 2007 .

[28]  Wen-Chih Peng,et al.  A gamma-based regression for winning price estimation in real-time bidding advertising , 2017, 2017 IEEE International Conference on Big Data (Big Data).

[29]  Wang Jun,et al.  Product-Based Neural Networks for User Response Prediction , 2016 .

[30]  Jun Wang,et al.  User Response Learning for Directly Optimizing Campaign Performance in Display Advertising , 2016, CIKM.

[31]  Jieping Ye,et al.  A Multi-Task Learning Formulation for Survival Analysis , 2016, KDD.

[32]  Jun Wang,et al.  Display Advertising with Real-Time Bidding (RTB) and Behavioural Targeting , 2016, Found. Trends Inf. Retr..

[33]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[34]  Jun Wang,et al.  An empirical study of reserve price optimisation in real-time bidding , 2014, KDD.

[35]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[36]  Guorui Zhou,et al.  Deep Interest Network for Click-Through Rate Prediction , 2017, KDD.

[37]  Wentong Li,et al.  Estimating conversion rate in display advertising from past erformance data , 2012, KDD.

[38]  Ming-Syan Chen,et al.  Deep Censored Learning of the Winning Price in the Real Time Bidding , 2018, KDD.

[39]  Yoshua Bengio,et al.  Architectural Complexity Measures of Recurrent Neural Networks , 2016, NIPS.

[40]  Ming-Syan Chen,et al.  Combining Powers of Two Predictors in Optimizing Real-Time Bidding Strategy under Constrained Budget , 2016, CIKM.

[41]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[42]  N. Graham,et al.  Areas beneath the relative operating characteristics (ROC) and relative operating levels (ROL) curves: Statistical significance and interpretation , 2002 .

[43]  Yong Yu,et al.  Neural Link Prediction over Aligned Networks , 2018, AAAI.

[44]  Jun Wang,et al.  Functional Bid Landscape Forecasting for Display Advertising , 2016, ECML/PKDD.

[45]  Richard Socher,et al.  Quasi-Recurrent Neural Networks , 2016, ICLR.

[46]  George Kurian,et al.  Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation , 2016, ArXiv.

[47]  Weinan Zhang,et al.  Optimal real-time bidding for display advertising , 2014, KDD.