Feedback Control of Real-Time Display Advertising

Real-Time Bidding (RTB) is revolutionising display advertising by facilitating per-impression auctions to buy ad impressions as they are being generated. Being able to use impression-level data, such as user cookies, encourages user behaviour targeting, and hence has significantly improved the effectiveness of ad campaigns. However, a fundamental drawback of RTB is its instability because the bid decision is made per impression and there are enormous fluctuations in campaigns' key performance indicators (KPIs). As such, advertisers face great difficulty in controlling their campaign performance against the associated costs. In this paper, we propose a feedback control mechanism for RTB which helps advertisers dynamically adjust the bids to effectively control the KPIs, e.g., the auction winning ratio and the effective cost per click. We further formulate an optimisation framework to show that the proposed feedback control mechanism also has the ability of optimising campaign performance. By settling the effective cost per click at an optimal reference value, the number of campaign's ad clicks can be maximised with the budget constraint. Our empirical study based on real-world data verifies the effectiveness and robustness of our RTB control system in various situations. The proposed feedback control mechanism has also been deployed on a commercial RTB platform and the online test has shown its success in generating controllable advertising performance.

[1]  Jianlong Zhang,et al.  Applications of feedback control in online advertising , 2013, 2013 American Control Conference.

[2]  Tie-Yan Liu,et al.  Joint optimization of bid and budget allocation in sponsored search , 2012, KDD.

[3]  Natasa Milic-Frayling,et al.  Network Analysis of Third Party Tracking: User Exposure to Tracking Cookies through Search , 2013, 2013 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT).

[4]  Nikhil R. Devanur,et al.  Real-time bidding algorithms for performance-based display ad allocation , 2011, KDD.

[5]  J. Tukey,et al.  Variations of Box Plots , 1978 .

[6]  Karl Johan Åström,et al.  Control: A perspective , 2014, Autom..

[7]  Kui Meng,et al.  Control Theory Based Rating Recommendation for Reputation Systems , 2006, 2006 IEEE International Conference on Networking, Sensing and Control.

[8]  Ali Jalali,et al.  Real time bid optimization with smooth budget delivery in online advertising , 2013, ADKDD '13.

[9]  Weinan Zhang,et al.  Optimal real-time bidding for display advertising , 2014, KDD.

[10]  Jun Wang,et al.  Real-time bidding for online advertising: measurement and analysis , 2013, ADKDD '13.

[11]  S. Muthukrishnan,et al.  Ad Exchanges: Research Issues , 2009, WINE.

[12]  Jun Wang,et al.  Using control theory for stable and efficient recommender systems , 2012, WWW.

[13]  Anton Schwaighofer,et al.  Budget Optimization for Sponsored Search: Censored Learning in MDPs , 2012, UAI.

[14]  Wei Li,et al.  Bid landscape forecasting in online ad exchange marketplace , 2011, KDD.

[15]  Diane J. Cook,et al.  Decision-Theoretic Layered Robotic Control Architecture , 1999, AAAI/IAAI.

[16]  M. Hoagland,et al.  Feedback Systems An Introduction for Scientists and Engineers SECOND EDITION , 2015 .

[17]  Mohd Firdaus,et al.  Water Level Controller , 2006 .

[18]  Matthew Richardson,et al.  Predicting clicks: estimating the click-through rate for new ads , 2007, WWW '07.

[19]  Yifan Hu,et al.  Collaborative Filtering for Implicit Feedback Datasets , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[20]  Jun Wang,et al.  Real-Time Bidding Benchmarking with iPinYou Dataset , 2014, ArXiv.

[21]  Shankar P. Bhattacharyya,et al.  Robust Control: The Parametric Approach , 1995 .

[22]  S. Bennett,et al.  Development of the PID controller , 1993, IEEE Control Systems.

[23]  David Lo,et al.  Predicting response in mobile advertising with hierarchical importance-aware factorization machine , 2014, WSDM.

[24]  M. Morari,et al.  Internal model control: PID controller design , 1986 .

[25]  Licia Capra,et al.  Dynamic updating of online recommender systems via feed-forward controllers , 2011, SEAMS '11.

[26]  Robert C. Nelson,et al.  Flight Stability and Automatic Control , 1989 .

[27]  Jun Wang,et al.  An empirical study of reserve price optimisation in real-time bidding , 2014, KDD.

[28]  S. Bhattacharyya,et al.  Robust control , 1987, IEEE Control Systems Magazine.

[29]  Xuehua Shen,et al.  iPinYou Global RTB Bidding Algorithm Competition Dataset , 2014, ADKDD'14.

[30]  J. Ackermann,et al.  Robust control , 2002 .

[31]  Wentong Li,et al.  Estimating conversion rate in display advertising from past erformance data , 2012, KDD.

[32]  Roberto Battiti,et al.  First- and Second-Order Methods for Learning: Between Steepest Descent and Newton's Method , 1992, Neural Computation.

[33]  Hang Li,et al.  Improving quality of training data for learning to rank using click-through data , 2010, WSDM '10.

[34]  Sergei Vassilvitskii,et al.  Handling forecast errors while bidding for display advertising , 2012, WWW.

[35]  Gabriel Y. Weintraub,et al.  Repeated Auctions with Budgets in Ad Exchanges: Approximations and Design , 2014, Manag. Sci..

[36]  Foster J. Provost,et al.  Bid optimizing and inventory scoring in targeted online advertising , 2012, KDD.