Search and Score-Based Waterfall Auction Optimization

Online advertising is a major source of income for many online companies. One common approach is to sell online advertisements via waterfall auctions, where a publisher makes sequential price offers to ad networks. The publisher controls the order and prices of the waterfall and by that aims to maximize his revenue. In this work, we propose a methodology to learn a waterfall strategy from historical data by wisely searching in the space of possible waterfalls and selecting the one leading to the highest revenue. The contribution of this work is twofold; First, we propose a novel method to estimate the valuation distribution of each user with respect to each ad network. Second, we utilize the valuation matrix to score our candidate waterfalls as part of a procedure that iteratively searches in local neighborhoods. Our framework guarantees that the waterfall revenue improves between iterations until converging to a local optimum. Real-world demonstrations are provided to show that the proposed method improves the total revenue of real-world waterfalls compared to manual expert optimization. Finally, the code and the data are available here.

[1]  Zheng Wen,et al.  Waterfall Bandits: Learning to Sell Ads Online , 2019, ArXiv.

[2]  Jun Wang,et al.  Display Advertising with Real-Time Bidding (RTB) and Behavioural Targeting , 2016, Found. Trends Inf. Retr..

[3]  Uzay Kaymak,et al.  A Reward Shaping Approach for Reserve Price Optimization using Deep Reinforcement Learning , 2021, 2021 International Joint Conference on Neural Networks (IJCNN).

[4]  Sebastian Scherer,et al.  Improving Stochastic Policy Gradients in Continuous Control with Deep Reinforcement Learning using the Beta Distribution , 2017, ICML.

[5]  Rémi Coulom,et al.  Efficient Selectivity and Backup Operators in Monte-Carlo Tree Search , 2006, Computers and Games.

[6]  Sudipto Guha,et al.  Approximation Schemes for Sequential Posted Pricing in Multi-unit Auctions , 2010, WINE.

[7]  Stylianos Despotakis,et al.  First-Price Auctions in Online Display Advertising , 2019, Journal of Marketing Research.

[8]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[9]  F. Famoye Continuous Univariate Distributions, Volume 1 , 1994 .

[10]  Uzay Kaymak,et al.  A Decision Support Method to Increase the Revenue of Ad Publishers in Waterfall Strategy , 2019, 2019 IEEE Conference on Computational Intelligence for Financial Engineering & Economics (CIFEr).

[11]  Nicolas Grislain,et al.  Maximizing net income of the auction waterfall with an abort decision tree , 2018, ArXiv.

[12]  Thomas Stützle,et al.  Stochastic Local Search: Foundations & Applications , 2004 .

[13]  Mauro Brunato,et al.  Reactive Search and Intelligent Optimization , 2008 .

[14]  N. L. Johnson,et al.  Continuous Univariate Distributions. , 1995 .

[15]  Dimitri P. Bertsekas,et al.  Convex Optimization Algorithms , 2015 .

[16]  Yingqian Zhang,et al.  A Reinforcement Learning Method to Select Ad Networks in Waterfall Strategy , 2019, BNAIC/BENELEARN.

[17]  Weinan Zhang,et al.  Optimal real-time bidding for display advertising , 2014, KDD.

[18]  Gregory F. Cooper,et al.  A Bayesian method for the induction of probabilistic networks from data , 1992, Machine Learning.

[19]  Oliver Busch The Programmatic Advertising Principle , 2016 .

[20]  S. Muthukrishnan,et al.  Ad Exchanges: Research Issues , 2009, WINE.