A General Theory of Sample Complexity for Multi-Item Profit Maximization

One of the most tantalizing and long-standing open problems in mechanism design is profit maximization in multi-item, multi-buyer settings. Much of the literature surrounding this problem rests on the strong assumption that the mechanism designer knows the distribution over buyers' values. In reality, this information is rarely available. The support of the distribution alone is often doubly exponential, so obtaining and storing the distribution is impractical. We relax this assumption and instead assume that the mechanism designer only has a set of samples from the distribution. We develop learning-theoretic foundations of sample-based mechanism design. In particular, we provide generalization guarantees which bound the difference between the empirical profit of a mechanism over a set of samples and its expected profit on the unknown distribution. In this paper, we present a general theory for deriving worst-case generalization bounds in multi-item settings, as well as data-dependent guarantees when the distribution over buyers' values is well-behaved. We analyze mechanism classes that have not yet been studied in the sample-based mechanism design literature and match or improve over the best-known guarantees for many of the special classes that have been studied. The classes we study include randomized mechanisms, pricing mechanisms, multi-part tariffs, and generalized VCG auctions such as affine maximizer auctions.

[1]  R. Buck Partition of Space , 1943 .

[2]  William Vickrey,et al.  Counterspeculation, Auctions, And Competitive Sealed Tenders , 1961 .

[3]  J. Lamperti ON CONVERGENCE OF STOCHASTIC PROCESSES , 1962 .

[4]  R. Dudley The Sizes of Compact Subsets of Hilbert Space and Continuity of Gaussian Processes , 1967 .

[5]  E. H. Clarke Multipart pricing of public goods , 1971 .

[6]  W. Oi A Disneyland Dilemma: Two-Part Tariffs for a Mickey Mouse Monopoly , 1971 .

[7]  M. Feldstein Equity and Efficiency in Public Sector Pricing: The Optimal Two-Part Tariff , 1972 .

[8]  Theodore Groves,et al.  Incentives in Teams , 1973 .

[9]  S. Rassenti,et al.  A Combinatorial Auction Mechanism for Airport Time Slot Allocation , 1982 .

[10]  C. Plott,et al.  A BINARY CONFLICT ASCENDING PRICE (BICAP) MECHANISM FOR THE DECENTRALIZED ALLOCATION OF THE RIGHT TO USE RAILROAD TRACKS. , 1996 .

[11]  Peter L. Bartlett,et al.  Rademacher and Gaussian Complexities: Risk Bounds and Structural Results , 2003, J. Mach. Learn. Res..

[12]  Vladimir Koltchinskii,et al.  Rademacher penalties and structural risk minimization , 2001, IEEE Trans. Inf. Theory.

[13]  Vincent Conitzer,et al.  Complexity of Mechanism Design , 2002, UAI.

[14]  T. Sandholm,et al.  Applications of Automated Mechanism Design , 2003 .

[15]  Noam Nisan,et al.  Towards a characterization of truthful combinatorial auctions , 2003, 44th Annual IEEE Symposium on Foundations of Computer Science, 2003. Proceedings..

[16]  Tuomas Sandholm,et al.  Automated Mechanism Design: A New Application Area for Search Algorithms , 2003, CP.

[17]  Tuomas Sandholm,et al.  Methods for Boosting Revenue in Combinatorial Auctions , 2004, AAAI.

[18]  Vincent Conitzer,et al.  Self-interested automated mechanism design and implications for optimal combinatorial auctions , 2004, EC '04.

[19]  Yoav Shoham,et al.  Combinatorial Auctions , 2005, Encyclopedia of Wireless Networks.

[20]  Michael Collins,et al.  Discriminative Reranking for Natural Language Parsing , 2000, CL.

[21]  Tuomas Sandholm,et al.  Approximating Revenue-Maximizing Combinatorial Auctions , 2005, AAAI.

[22]  Edith Elkind,et al.  Designing and learning optimal finite support auctions , 2007, SODA '07.

[23]  Philippe Jehiel,et al.  Mixed Bundling Auctions , 2006, J. Econ. Theory.

[24]  Shuchi Chawla,et al.  Algorithmic pricing via virtual valuations , 2007, EC '07.

[25]  Shahar Dobzinski,et al.  On characterizations of truthful mechanisms for combinatorial auctions and scheduling , 2008, EC '08.

[26]  Maria-Florina Balcan,et al.  Reducing mechanism design to algorithm design via machine learning , 2007, J. Comput. Syst. Sci..

[27]  Tim Roughgarden,et al.  Simple versus optimal mechanisms , 2009, SECO.

[28]  Shahar Dobzinski,et al.  On the Power of Randomization in Algorithmic Mechanism Design , 2009, 2009 50th Annual IEEE Symposium on Foundations of Computer Science.

[29]  S. Matthew Weinberg,et al.  Pricing randomized allocations , 2009, SODA '10.

[30]  Shuchi Chawla,et al.  The power of randomness in bayesian optimal mechanism design , 2010, EC '10.

[31]  Noam Nisan,et al.  Approximate revenue maximization with multiple items , 2012, EC '12.

[32]  Tuomas Sandholm,et al.  Mixed-bundling auctions with reserve prices , 2012, AAMAS.

[33]  Yang Cai,et al.  An algorithmic characterization of multi-dimensional mechanisms , 2011, STOC '12.

[34]  S. Matthew Weinberg,et al.  Matroid prophet inequalities , 2012, STOC '12.

[35]  S. Matthew Weinberg,et al.  Symmetries and optimal multi-dimensional mechanism design , 2012, EC '12.

[36]  Yang Cai,et al.  Reducing Revenue to Welfare Maximization: Approximation Algorithms and other Generalizations , 2013, SODA.

[37]  Richard Cole,et al.  The sample complexity of revenue maximization , 2014, STOC.

[38]  Maria-Florina Balcan,et al.  Learning Economic Parameters from Revealed Preferences , 2014, WINE.

[39]  S. Matthew Weinberg,et al.  A Simple and Approximately Optimal Mechanism for an Additive Buyer , 2014, 2014 IEEE 55th Annual Symposium on Foundations of Computer Science.

[40]  Shai Ben-David,et al.  Understanding Machine Learning: From Theory to Algorithms , 2014 .

[41]  Mehryar Mohri,et al.  Learning Theory and Algorithms for revenue optimization in second price auctions with reserve , 2013, ICML.

[42]  Shuchi Chawla,et al.  Mechanism design for data science , 2014, EC.

[43]  Tim Roughgarden,et al.  On the Pseudo-Dimension of Nearly Optimal Auctions , 2015, NIPS.

[44]  Tuomas Sandholm,et al.  Automated Design of Revenue-Maximizing Combinatorial Auctions , 2015, Oper. Res..

[45]  Andrew Chi-Chih Yao,et al.  An n-to-1 Bidder Reduction for Multi-item Auctions and its Applications , 2014, SODA.

[46]  Michal Feldman,et al.  Combinatorial Auctions via Posted Prices , 2014, SODA.

[47]  Tim Roughgarden,et al.  Making the Most of Your Samples , 2014, EC.

[48]  Claudio Gentile,et al.  Ieee Transactions on Information Theory 1 Regret Minimization for Reserve Prices in Second-price Auctions , 2022 .

[49]  Eli Upfal,et al.  Mining Frequent Itemsets through Progressive Sampling with Rademacher Averages , 2015, KDD.

[50]  Nikhil R. Devanur,et al.  A duality-based unified approach to Bayesian mechanism design , 2016, SECO.

[51]  David C. Parkes,et al.  Automated Mechanism Design without Money via Machine Learning , 2016, IJCAI.

[52]  Anna R. Karlin,et al.  A Prior-Independent Revenue-Maximizing Auction for Multiple Additive Bidders , 2016, WINE.

[53]  Constantinos Daskalakis,et al.  Learning in Auctions: Regret is Hard, Envy is Easy , 2015, 2016 IEEE 57th Annual Symposium on Foundations of Computer Science (FOCS).

[54]  David C. Parkes,et al.  A General Statistical Framework for Designing Strategy-proof Assignment Mechanisms , 2016, UAI.

[55]  Tim Roughgarden,et al.  Learning Simple Auctions , 2016, COLT.

[56]  Aviad Rubinstein On the Computational Complexity of Optimal Simple Mechanisms , 2016, ITCS.

[57]  Maria-Florina Balcan,et al.  Sample Complexity of Automated Mechanism Design , 2016, NIPS.

[58]  Jason D. Hartline,et al.  Non-Revelation Mechanism Design , 2016, ArXiv.

[59]  Tim Roughgarden,et al.  Ironing in the Dark , 2015, EC.

[60]  Nikhil R. Devanur,et al.  The sample complexity of auctions with side information , 2015, STOC.

[61]  Justin Hsu,et al.  Do prices coordinate markets? , 2015, SECO.

[62]  Moshe Babaioff,et al.  The menu-size complexity of revenue approximation , 2016, STOC.

[63]  Sergei Vassilvitskii,et al.  Revenue Optimization with Approximate Bid Predictions , 2017, NIPS.

[64]  Vasilis Syrgkanis A Sample Complexity Measure with Applications to Learning Optimal Auctions , 2017, NIPS.

[65]  Nikhil R. Devanur,et al.  Online Auctions and Multi-scale Online Learning , 2017, EC.

[66]  Yang Cai,et al.  Learning Multi-Item Auctions with (or without) Samples , 2017, 2017 IEEE 58th Annual Symposium on Foundations of Computer Science (FOCS).

[67]  Yannai A. Gonczarowski,et al.  Efficient empirical revenue maximization in single-parameter auction environments , 2016, STOC.

[68]  Noga Alon,et al.  Submultiplicative Glivenko-Cantelli and Uniform Convergence of Revenues , 2017, NIPS.

[69]  Jason D. Hartline,et al.  Sample Complexity for Non-Truthful Mechanisms , 2016, EC.

[70]  Raghuram Iyengar,et al.  Nonlinear pricing , 2022 .