Contextual Reserve Price Optimization in Auctions

We study the problem of learning a linear model to set the reserve price in an auction, given contextual information, in order to maximize expected revenue from the seller side. First, we show that it is not possible to solve this problem in polynomial time unless the \emph{Exponential Time Hypothesis} fails. Second, we present a strong mixed-integer programming (MIP) formulation for this problem, which is capable of exactly modeling the nonconvex and discontinuous expected reward function. Moreover, we show that this MIP formulation is ideal (i.e. the strongest possible formulation) for the revenue function of a single impression. Since it can be computationally expensive to exactly solve the MIP formulation in practice, we also study the performance of its linear programming (LP) relaxation. Though it may work well in practice, we show that, unfortunately, in the worst case the optimal objective of the LP relaxation can be O(number of samples) times larger than the optimal objective of the true problem. Finally, we present computational results, showcasing that the MIP formulation, along with its LP relaxation, are able to achieve superior in- and out-of-sample performance, as compared to state-of-the-art algorithms on both real and synthetic datasets. More broadly, we believe this work offers an indication of the strength of optimization methodologies like MIP to exactly model intrinsic discontinuities in machine learning problems.

[1]  Alan Edelman,et al.  Julia: A Fresh Approach to Numerical Computing , 2014, SIAM Rev..

[2]  Gustav Nordh,et al.  Complexity of SAT Problems, Clone Theory and the Exponential Time Hypothesis , 2013, SODA.

[3]  Scott Kuindersma,et al.  Optimization-based locomotion planning, estimation, and control design for the atlas humanoid robot , 2015, Autonomous Robots.

[4]  Russell Impagliazzo,et al.  Complexity of k-SAT , 1999, Proceedings. Fourteenth Annual IEEE Conference on Computational Complexity (Formerly: Structure in Complexity Theory Conference) (Cat.No.99CB36317).

[5]  Russ Tedrake,et al.  Verifying Neural Networks with Mixed Integer Programming , 2017, ArXiv.

[6]  A. Fügenschuh,et al.  Mixed-integer linear methods for layout-optimization of screening systems in recovered paper production , 2014 .

[7]  Yijia Chen,et al.  The Exponential Time Hypothesis and the Parameterized Clique Problem , 2012, IPEC.

[8]  Hamid Nazerzadeh,et al.  Dynamic Reserve Prices for Repeated Auctions: Learning from Bids , 2014, ArXiv.

[9]  Umar Syed,et al.  Learning Prices for Repeated Auctions with Strategic Buyers , 2013, NIPS.

[10]  Craig Boutilier,et al.  CAQL: Continuous Action Q-Learning , 2020, ICLR.

[11]  Thomas L. Magnanti,et al.  Variable Disaggregation in Network Flow Problems with Piecewise Linear Costs , 2007, Oper. Res..

[12]  Mark Braverman,et al.  Approximating the best Nash Equilibrium in no(log n)-time breaks the Exponential Time Hypothesis , 2015, Electron. Colloquium Comput. Complex..

[13]  Robin Deits,et al.  Footstep planning on uneven terrain with mixed-integer convex optimization , 2014, 2014 IEEE-RAS International Conference on Humanoid Robots.

[14]  Iain Dunning,et al.  JuMP: A Modeling Language for Mathematical Optimization , 2015, SIAM Rev..

[15]  Mehryar Mohri,et al.  Learning Algorithms for Second-Price Auctions with Reserve , 2016, J. Mach. Learn. Res..

[16]  Omri Weinstein,et al.  ETH Hardness for Densest-k-Subgraph with Perfect Completeness , 2015, SODA.

[17]  J. K. Lowe Modelling with Integer Variables. , 1984 .

[18]  Richard M. Karp,et al.  On the Computational Complexity of Combinatorial Problems , 1975, Networks.

[19]  Virginia Vassilevska Williams,et al.  Hardness of Easy Problems: Basing Hardness on Popular Conjectures such as the Strong Exponential Time Hypothesis (Invited Talk) , 2015, IPEC.

[20]  Vijay Kumar,et al.  Mixed-integer quadratic program trajectory generation for heterogeneous quadrotor teams , 2012, 2012 IEEE International Conference on Robotics and Automation.

[21]  R. Horst,et al.  DC Programming: Overview , 1999 .

[22]  Egon Balas,et al.  programming: Properties of the convex hull of feasible points * , 1998 .

[23]  Michael Ostrovsky,et al.  Reserve Prices in Internet Advertising Auctions: A Field Experiment , 2009, Journal of Political Economy.

[24]  Pascal Van Hentenryck,et al.  Simulation of Hybrid Circuits in Constraint Logic Programming , 1989, IJCAI.

[25]  Thomas L. Magnanti,et al.  A Comparison of Mixed - Integer Programming Models for Nonconvex Piecewise Linear Cost Minimization Problems , 2003, Manag. Sci..

[26]  Claudio Gentile,et al.  Ieee Transactions on Information Theory 1 Regret Minimization for Reserve Prices in Second-price Auctions , 2022 .

[27]  M. van Beek An Algorithmic Approach to Linear Regression , 2018 .

[28]  Christian Tjandraatmadja,et al.  Strong mixed-integer programming formulations for trained neural networks , 2018, Mathematical Programming.

[29]  Dimitris Bertsimas,et al.  Optimal classification trees , 2017, Machine Learning.

[30]  Juan Pablo Vielma,et al.  Mixed Integer Linear Programming Formulation Techniques , 2015, SIAM Rev..

[31]  Iain Dunning,et al.  Computing in Operations Research Using Julia , 2013, INFORMS J. Comput..

[32]  Pasin Manurangsi,et al.  Almost-polynomial ratio ETH-hardness of approximating densest k-subgraph , 2016, STOC.

[33]  G. Nemhauser,et al.  Integer Programming , 2020 .

[34]  Dániel Marx,et al.  Lower bounds based on the Exponential Time Hypothesis , 2011, Bull. EATCS.

[35]  Mohammad Taghi Hajiaghayi,et al.  A Tight Algorithm for Strongly Connected Steiner Subgraph on Two Terminals with Demands , 2014, Algorithmica.

[36]  Divesh Aggarwal,et al.  (Gap/S)ETH hardness of SVP , 2017, STOC.

[37]  E. Balas Disjunctive programming and a hierarchy of relaxations for discrete optimization problems , 1985 .

[38]  Robin Deits,et al.  Efficient mixed-integer planning for UAVs in cluttered environments , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[39]  D. Z. Wang,et al.  Global optimization method for network design problem with stochastic user equilibrium , 2015 .