Unknown I.I.D. Prophets: Better Bounds, Streaming Algorithms, and a New Impossibility

A prophet inequality states, for some $\alpha\in[0,1]$, that the expected value achievable by a gambler who sequentially observes random variables $X_1,\dots,X_n$ and selects one of them is at least an $\alpha$ fraction of the maximum value in the sequence. We obtain three distinct improvements for a setting that was first studied by Correa et al. (EC, 2019) and is particularly relevant to modern applications in algorithmic pricing. In this setting, the random variables are i.i.d. from an unknown distribution and the gambler has access to an additional $\beta n$ samples for some $\beta\geq 0$. We first give improved lower bounds on $\alpha$ for a wide range of values of $\beta$; specifically, $\alpha\geq(1+\beta)/e$ when $\beta\leq 1/(e-1)$, which is tight, and $\alpha\geq 0.648$ when $\beta=1$, which improves on a bound of around $0.635$ due to Correa et al. (SODA, 2020). Adding to their practical appeal, specifically in the context of algorithmic pricing, we then show that the new bounds can be obtained even in a streaming model of computation and thus in situations where the use of relevant data is complicated by the sheer amount of data available. We finally establish that the upper bound of $1/e$ for the case without samples is robust to additional information about the distribution, and applies also to sequences of i.i.d. random variables whose distribution is itself drawn, according to a known distribution, from a finite set of known candidate distributions. This implies a tight prophet inequality for exchangeable sequences of random variables, answering a question of Hill and Kertz (Contemporary Mathematics, 1992), but leaves open the possibility of better guarantees when the number of candidate distributions is small, a setting we believe is of strong interest to applications.

[1]  H. W. Kuhn,et al.  11. Extensive Games and the Problem of Information , 1953 .

[2]  E. Samuel-Cahn Comparison of Threshold Stop Rules and Maximum for Independent Nonnegative Random Variables , 1984 .

[3]  Aviad Rubinstein,et al.  Beyond matroids: secretary problem and prophet inequality with general constraints , 2016, STOC.

[4]  Ola Svensson,et al.  The one-way communication complexity of submodular maximization with applications to streaming and robustness , 2020, STOC.

[5]  Mohammad Taghi Hajiaghayi,et al.  Prophet Inequality and Online Auctions , 2016, Encyclopedia of Algorithms.

[6]  T. Hill,et al.  Comparisons of Stop Rule and Supremum Expectations of I.I.D. Random Variables , 1982 .

[7]  A. V. den Boer,et al.  Dynamic Pricing and Learning: Historical Origins, Current Research, and New Directions , 2013 .

[8]  Paul Dütting,et al.  Posted Pricing and Prophet Inequalities with Inaccurate Priors , 2019, EC.

[9]  Haim Kaplan,et al.  Competitive Analysis with a Sample and the Secretary Problem , 2019, SODA.

[10]  Sudipto Guha,et al.  Stream Order and Order Statistics: Quantile Estimation in Random-Order Streams , 2009, SIAM J. Comput..

[11]  Frank Plumpton Ramsey,et al.  On a Problem of Formal Logic , 1930 .

[12]  Sahil Singla,et al.  Combinatorial Prophet Inequalities , 2016, SODA.

[13]  Thomas S. Ferguson,et al.  Who Solved the Secretary Problem , 1989 .

[14]  Paul Dütting,et al.  Prophet Inequalities Made Easy: Stochastic Optimization by Pricing Nonstochastic Inputs , 2020, SIAM J. Comput..

[15]  Andreas Krause,et al.  Streaming submodular maximization: massive data summarization on the fly , 2014, KDD.

[16]  Richard Cole,et al.  The sample complexity of revenue maximization , 2014, STOC.

[17]  Maria-Florina Balcan,et al.  Data-Driven Clustering via Parameterized Lloyd's Families , 2018, NeurIPS.

[18]  Paul Dütting,et al.  An O(log log m) Prophet Inequality for Subadditive Combinatorial Auctions , 2020, 2020 IEEE 61st Annual Symposium on Foundations of Computer Science (FOCS).

[19]  Mohammad Taghi Hajiaghayi,et al.  Prophet Secretary , 2015, ESA.

[20]  T. Hill,et al.  A Survey of Prophet Inequalities in Optimal Stopping Theory , 1992 .

[21]  José R. Correa,et al.  Prophet Inequalities for I.I.D. Random Variables from an Unknown Distribution , 2019, EC.

[22]  Kim-Hung Li,et al.  Reservoir-sampling algorithms of time complexity O(n(1 + log(N/n))) , 1994, TOMS.

[23]  D. H. D. West Updating mean and variance estimates: an improved method , 1979, CACM.

[24]  Tim Roughgarden,et al.  On the Pseudo-Dimension of Nearly Optimal Auctions , 2015, NIPS.

[25]  Jeffrey Scott Vitter,et al.  Random sampling with a reservoir , 1985, TOMS.

[26]  Paul Dütting,et al.  Polymatroid Prophet Inequalities , 2013, ESA.

[27]  Maria-Florina Balcan,et al.  Dispersion for Data-Driven Algorithm Design, Online Learning, and Private Optimization , 2017, 2018 IEEE 59th Annual Symposium on Foundations of Computer Science (FOCS).

[28]  Nicole Immorlica,et al.  Prophet Inequalities with Linear Correlations and Augmentations , 2020, EC.

[29]  Michal Feldman,et al.  Online Stochastic Max-Weight Matching: Prophet Inequality for Vertex and Edge Arrival Models , 2020, EC.

[30]  Michal Feldman,et al.  Combinatorial Auctions via Posted Prices , 2014, SODA.

[31]  Nick Gravin,et al.  Prophet Inequality for Bipartite Matching: Merits of Being Simple and Non Adaptive , 2019, EC.

[32]  S. Matthew Weinberg,et al.  Optimal Single-Choice Prophet Inequalities from Samples , 2019, ITCS.

[33]  José R. Correa,et al.  Prophet secretary through blind strategies , 2018, Mathematical Programming.

[34]  Mohammad Taghi Hajiaghayi,et al.  Beating 1-1/e for ordered prophets , 2017, STOC.

[35]  S. Muthukrishnan,et al.  Data streams: algorithms and applications , 2005, SODA '03.

[36]  Yosef Rinott,et al.  Comparisons of optimal stopping values and prophet inequalities for negatively dependent random variables , 1987 .

[37]  Comparison of stop rule and maximum expectations for finite sequences of exchangeable random variables , 1991 .

[38]  Saeed Alaei,et al.  Bayesian Combinatorial Auctions: Expanding Single Buyer Mechanisms to Many Buyers , 2011, 2011 IEEE 52nd Annual Symposium on Foundations of Computer Science.

[39]  José R. Correa,et al.  The Two-Sided Game of Googol and Sample-Based Prophet Inequalities , 2020, SODA.

[40]  D. Conlon,et al.  Hypergraph Ramsey numbers , 2008, 0808.3760.

[41]  Shipra Agrawal,et al.  On Optimal Ordering in the Optimal Stopping Problem , 2019, EC.

[42]  Haim Kaplan,et al.  Prophet Secretary: Surpassing the 1-1/e Barrier , 2017, EC.

[43]  Tim Roughgarden,et al.  A PAC Approach to Application-Specific Algorithm Selection , 2017, SIAM J. Comput..

[44]  Shuchi Chawla,et al.  Pricing for Online Resource Allocation: Intervals and Paths , 2019, SODA.

[45]  Mohammad Taghi Hajiaghayi,et al.  Prophet Secretary for Combinatorial Auctions and Matroids , 2017, SODA.

[46]  Moshe Babaioff,et al.  Posting Prices with Unknown Distributions , 2017, ICS.

[47]  U. Krengel,et al.  Semiamarts and finite values , 1977 .

[48]  José R. Correa,et al.  Posted Price Mechanisms for a Random Stream of Customers , 2017, EC.

[49]  S. Matthew Weinberg,et al.  Prophet Inequalities with Limited Information , 2013, SODA.