Sample Complexity of Multi-Item Profit Maximization

We study the design of pricing mechanisms and auctions when the mechanism designer does not know the distribution of buyers' values. Instead the mechanism designer receives a set of samples from this distribution and his goal is to use the sample to design a pricing mechanism or auction with high expected profit. We provide generalization guarantees which bound the difference between average profit on the sample and expected profit over the distribution. These bounds are directly proportional to the intrinsic complexity of the mechanism class the designer is optimizing over. We present a single, overarching theorem that uses empirical Rademacher complexity to measure the intrinsic complexity of a variety of widely-studied single- and multi-item auction classes, including affine maximizer auctions, mixed-bundling auctions, and second-price item auctions. Despite the extensive applicability of our main theorem, we match and improve over the best-known generalization guarantees for many auction classes. This all-encompassing theorem also applies to multi- and single-item pricing mechanisms in both multi- and single-unit settings, such as linear and non-linear pricing mechanisms. Finally, our central theorem allows us to easily derive generalization guarantees for every class in several finely grained hierarchies of auction and pricing mechanism classes. We demonstrate how to determine the precise level in a hierarchy with the optimal tradeoff between profit and generalization using structural profit maximization. The mechanism classes we study are significantly different from well-understood function classes typically found in machine learning, so bounding their complexity requires a sharp understanding of the interplay between mechanism parameters and buyer valuations.

[1]  Moshe Babaioff,et al.  The menu-size complexity of revenue approximation , 2016, STOC.

[2]  Shuchi Chawla,et al.  Multi-parameter mechanism design and sequential posted pricing , 2010, BQGT.

[3]  Constantinos Daskalakis,et al.  Learning in Auctions: Regret is Hard, Envy is Easy , 2015, 2016 IEEE 57th Annual Symposium on Foundations of Computer Science (FOCS).

[4]  Nikhil R. Devanur,et al.  Online Auctions and Multi-scale Online Learning , 2017, EC.

[5]  Anna R. Karlin,et al.  A Prior-Independent Revenue-Maximizing Auction for Multiple Additive Bidders , 2016, WINE.

[6]  Tuomas Sandholm,et al.  Methods for Boosting Revenue in Combinatorial Auctions , 2004, AAAI.

[7]  Tuomas Sandholm,et al.  Approximating Revenue-Maximizing Combinatorial Auctions , 2005, AAAI.

[8]  Maria-Florina Balcan,et al.  Sample Complexity of Automated Mechanism Design , 2016, NIPS.

[9]  S. Matthew Weinberg,et al.  Pricing randomized allocations , 2009, SODA '10.

[10]  Ameet Talwalkar,et al.  Foundations of Machine Learning , 2012, Adaptive computation and machine learning.

[11]  Tim Roughgarden,et al.  Learning Simple Auctions , 2016, COLT.

[12]  R. Buck Partition of Space , 1943 .

[13]  William Vickrey,et al.  Counterspeculation, Auctions, And Competitive Sealed Tenders , 1961 .

[14]  Claudio Gentile,et al.  Regret Minimization for Reserve Prices in Second-Price Auctions , 2015, IEEE Trans. Inf. Theory.

[15]  Noam Nisan,et al.  Towards a characterization of truthful combinatorial auctions , 2003, 44th Annual IEEE Symposium on Foundations of Computer Science, 2003. Proceedings..

[16]  Edith Elkind,et al.  Designing and learning optimal finite support auctions , 2007, SODA '07.

[17]  Tuomas Sandholm,et al.  Automated Mechanism Design: A New Application Area for Search Algorithms , 2003, CP.

[18]  C. Plott,et al.  A BINARY CONFLICT ASCENDING PRICE (BICAP) MECHANISM FOR THE DECENTRALIZED ALLOCATION OF THE RIGHT TO USE RAILROAD TRACKS. , 1996 .

[19]  Michel Gendreau,et al.  Combinatorial auctions , 2007, Ann. Oper. Res..

[20]  Nikhil R. Devanur,et al.  The sample complexity of auctions with side information , 2015, STOC.

[21]  Maria-Florina Balcan,et al.  Learning Economic Parameters from Revealed Preferences , 2014, WINE.

[22]  Tuomas Sandholm,et al.  Mixed-bundling auctions with reserve prices , 2012, AAMAS.

[23]  Vladimir Koltchinskii,et al.  Rademacher penalties and structural risk minimization , 2001, IEEE Trans. Inf. Theory.

[24]  Maria-Florina Balcan,et al.  Reducing mechanism design to algorithm design via machine learning , 2007, J. Comput. Syst. Sci..

[25]  Yannai A. Gonczarowski,et al.  Efficient empirical revenue maximization in single-parameter auction environments , 2016, STOC.

[26]  Tim Roughgarden,et al.  On the Pseudo-Dimension of Nearly Optimal Auctions , 2015, NIPS.

[27]  Shahar Dobzinski,et al.  On characterizations of truthful mechanisms for combinatorial auctions and scheduling , 2008, EC '08.

[28]  D. Pollard Convergence of stochastic processes , 1984 .

[29]  Tim Roughgarden,et al.  Making the Most of Your Samples , 2014, EC.

[30]  Jason D. Hartline,et al.  Sample Complexity for Non-Truthful Mechanisms , 2016, EC.

[31]  Shuchi Chawla,et al.  The power of randomness in bayesian optimal mechanism design , 2010, EC '10.

[32]  Justin Hsu,et al.  Do prices coordinate markets? , 2015, SECO.

[33]  Shahar Dobzinski,et al.  On the Power of Randomization in Algorithmic Mechanism Design , 2009, 2009 50th Annual IEEE Symposium on Foundations of Computer Science.

[34]  Vincent Conitzer,et al.  Self-interested automated mechanism design and implications for optimal combinatorial auctions , 2004, EC '04.

[35]  Vincent Conitzer,et al.  Complexity of Mechanism Design , 2002, UAI.

[36]  Aviad Rubinstein On the Computational Complexity of Optimal Simple Mechanisms , 2016, ITCS.

[37]  Peter L. Bartlett,et al.  Rademacher and Gaussian Complexities: Risk Bounds and Structural Results , 2003, J. Mach. Learn. Res..

[38]  S. Matthew Weinberg,et al.  Symmetries and optimal multi-dimensional mechanism design , 2012, EC '12.

[39]  Philippe Jehiel,et al.  Mixed Bundling Auctions , 2006, J. Econ. Theory.

[40]  Yang Cai,et al.  Reducing Revenue to Welfare Maximization: Approximation Algorithms and other Generalizations , 2013, SODA.

[41]  Michal Feldman,et al.  Combinatorial Auctions via Posted Prices , 2014, SODA.

[42]  E. H. Clarke Multipart pricing of public goods , 1971 .

[43]  Vasilis Syrgkanis A Sample Complexity Measure with Applications to Learning Optimal Auctions , 2017, NIPS.

[44]  Shuchi Chawla,et al.  Mechanism design for data science , 2014, EC.

[45]  Yang Cai,et al.  Learning Multi-Item Auctions with (or without) Samples , 2017, 2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS).

[46]  Theodore Groves,et al.  Incentives in Teams , 1973 .

[47]  David C. Parkes,et al.  Automated Mechanism Design without Money via Machine Learning , 2016, IJCAI.

[48]  Mehryar Mohri,et al.  Learning Theory and Algorithms for revenue optimization in second price auctions with reserve , 2013, ICML.

[49]  Tim Roughgarden,et al.  Ironing in the Dark , 2015, EC.

[50]  S. Rassenti,et al.  A Combinatorial Auction Mechanism for Airport Time Slot Allocation , 1982 .

[51]  Yang Cai,et al.  A duality-based unified approach to Bayesian mechanism design , 2016, SECO.

[52]  David C. Parkes,et al.  A General Statistical Framework for Designing Strategy-proof Assignment Mechanisms , 2016, UAI.

[53]  S. Matthew Weinberg,et al.  A Simple and Approximately Optimal Mechanism for an Additive Buyer , 2014, 2014 IEEE 55th Annual Symposium on Foundations of Computer Science.

[54]  Tuomas Sandholm,et al.  Automated Design of Revenue-Maximizing Combinatorial Auctions , 2015, Oper. Res..

[55]  R. Dudley The Sizes of Compact Subsets of Hilbert Space and Continuity of Gaussian Processes , 1967 .

[56]  Sergei Vassilvitskii,et al.  Revenue Optimization with Approximate Bid Predictions , 2017, NIPS.

[57]  Shai Ben-David,et al.  Understanding Machine Learning: From Theory to Algorithms , 2014 .

[58]  Noga Alon,et al.  Submultiplicative Glivenko-Cantelli and Uniform Convergence of Revenues , 2017, NIPS.

[59]  Yoav Shoham,et al.  Combinatorial Auctions , 2005, Encyclopedia of Wireless Networks.

[60]  S. Matthew Weinberg,et al.  Matroid prophet inequalities , 2012, STOC '12.

[61]  Richard Cole,et al.  The sample complexity of revenue maximization , 2014, STOC.

[62]  Michael Collins,et al.  Discriminative Reranking for Natural Language Parsing , 2000, CL.

[63]  Shuchi Chawla,et al.  Algorithmic pricing via virtual valuations , 2007, EC '07.

[64]  Tim Roughgarden,et al.  Simple versus optimal mechanisms , 2009, EC '09.

[65]  Yang Cai,et al.  An algorithmic characterization of multi-dimensional mechanisms , 2011, STOC '12.

[66]  Nikhil R. Devanur,et al.  A Duality-Based Unified Approach to Bayesian Mechanism Design , 2019, SIAM J. Comput..

[67]  Eli Upfal,et al.  Mining Frequent Itemsets through Progressive Sampling with Rademacher Averages , 2015, KDD.

[68]  Nir Shabbat Approximate Revenue Maximization with Multiple Items , 2012 .

[69]  Andrew Chi-Chih Yao,et al.  An n-to-1 Bidder Reduction for Multi-item Auctions and its Applications , 2014, SODA.