Adaptivity Gaps for Stochastic Probing: Submodular and XOS Functions

Suppose we are given a submodular function f over a set of elements, and we want to maximize its value subject to certain constraints. Good approximation algorithms are known for such problems under both monotone and non-monotone submodular functions. We consider these problems in a stochastic setting, where elements are not all active and we only get value from active elements. Each element e is active independently with some known probability pe, but we don't know the element's status a priori: we find it out only when we probe the element e. Moreover, the sequence of elements we probe must satisfy a given prefix-closed constraint, e.g., matroid, orienteering, deadline, precedence, or any downward-closed constraint. In this paper we study the gap between adaptive and non-adaptive strategies for f being a submodular or a fractionally subadditive (XOS) function. If this gap is small, we can focus on finding good non-adaptive strategies instead, which are easier to find as well as to represent. We show that the adaptivity gap is a constant for monotone and non-monotone submodular functions, and logarithmic for XOS functions of small width. These bounds are nearly tight. Our techniques show new ways of arguing about the optimal adaptive decision tree for stochastic optimization problems.

[1]  Maxim Sviridenko,et al.  Submodular Stochastic Probing on Matroids , 2013, Math. Oper. Res..

[2]  Lisa Hellerstein,et al.  Discrete Stochastic Submodular Maximization: Adaptive vs. Non-adaptive vs. Offline , 2015, CIAC.

[3]  Vahab S. Mirrokni,et al.  Non-monotone submodular maximization under matroid and knapsack constraints , 2009, STOC '09.

[4]  Amin Saberi,et al.  Stochastic Submodular Maximization , 2008, WINE.

[5]  Marek Adamczyk,et al.  Improved analysis of the greedy algorithm for stochastic matching , 2011, Inf. Process. Lett..

[6]  Ashish Goel,et al.  Improved approximation results for stochastic knapsack problems , 2011, SODA '11.

[7]  Jan Vondrák,et al.  Maximizing a Monotone Submodular Function Subject to a Matroid Constraint , 2011, SIAM J. Comput..

[8]  Atri Rudra,et al.  Approximating Matches Made in Heaven , 2009, ICALP.

[9]  Sudipto Guha,et al.  Approximation algorithms for budgeted learning problems , 2007, STOC '07.

[10]  Jian Li,et al.  Stochastic combinatorial optimization via poisson approximation , 2012, STOC '13.

[11]  Jan Vondrák,et al.  Approximating the stochastic knapsack problem: the benefit of adaptivity , 2004, 45th Annual IEEE Symposium on Foundations of Computer Science.

[12]  Anupam Gupta,et al.  A Stochastic Probing Problem with Applications , 2013, IPCO.

[13]  Fabrizio Grandoni,et al.  Improved Approximation Algorithms for Stochastic Matching , 2015, ESA.

[14]  Joseph Naor,et al.  A Unified Continuous Greedy Algorithm for Submodular Maximization , 2011, 2011 IEEE 52nd Annual Symposium on Foundations of Computer Science.

[15]  Éva Tardos,et al.  Maximizing the Spread of Influence through a Social Network , 2015, Theory Comput..

[16]  Vahab S. Mirrokni,et al.  Maximizing Non-Monotone Submodular Functions , 2011, 48th Annual IEEE Symposium on Foundations of Computer Science (FOCS'07).

[17]  Tim Roughgarden,et al.  Sketching valuation functions , 2012, SODA.

[18]  Aravind Srinivasan,et al.  Improved Bounds in Stochastic Matching and Optimization , 2015, APPROX-RANDOM.

[19]  Sudipto Guha,et al.  Approximation Algorithms for Bayesian Multi-Armed Bandit Problems , 2013, ArXiv.

[20]  A. Roth,et al.  New Challenges in Multihospital Kidney Exchange. , 2012, The American economic review.

[21]  Jan Vondrák,et al.  Adaptivity and approximation for stochastic packing problems , 2005, SODA '05.

[22]  Chandra Chekuri,et al.  A recursive greedy algorithm for walks in directed graphs , 2005, 46th Annual IEEE Symposium on Foundations of Computer Science (FOCS'05).

[23]  Nikhil Bansal,et al.  On the adaptivity gap of stochastic orienteering , 2013, Mathematical Programming.

[24]  David P. Williamson,et al.  The Design of Approximation Algorithms , 2011 .

[25]  Anupam Gupta,et al.  Algorithms and Adaptivity Gaps for Stochastic Probing , 2016, SODA.

[26]  D. Freedman On Tail Probabilities for Martingales , 1975 .

[27]  Andreas Krause,et al.  Submodularity in Machine Learning and Vision , 2013, BMVC.

[28]  Alvin E. Roth,et al.  Pairwise Kidney Exchange , 2004, J. Econ. Theory.

[29]  Hao Yang,et al.  Near-optimal algorithms for shared filter evaluation in data stream systems , 2008, SIGMOD Conference.

[30]  Uriel Feige,et al.  On maximizing welfare when utility functions are subadditive , 2006, STOC '06.

[31]  Will Ma,et al.  Improvements and Generalizations of Stochastic Knapsack and Multi-Armed Bandit Approximation Algorithms: Extended Abstract , 2013, SODA.

[32]  Atri Rudra,et al.  When LP Is the Cure for Your Matching Woes: Improved Bounds for Stochastic Matchings , 2010, Algorithmica.

[33]  R. Ravi,et al.  Approximation algorithms for stochastic orienteering , 2012, SODA.

[34]  R. Ravi,et al.  Approximation Algorithms for Correlated Knapsacks and Non-martingale Bandits , 2011, 2011 IEEE 52nd Annual Symposium on Foundations of Computer Science.

[35]  Hamid Nazerzadeh,et al.  Maximizing Stochastic Monotone Submodular Functions , 2009, Manag. Sci..

[36]  Sudipto Guha,et al.  Multi-armed Bandits with Metric Switching Costs , 2009, ICALP.

[37]  Shahar Dobzinski,et al.  Two Randomized Mechanisms for Combinatorial Auctions , 2007, APPROX-RANDOM.

[38]  Maria-Florina Balcan,et al.  Learning submodular functions , 2010, ECML/PKDD.

[39]  Joseph Naor,et al.  Submodular Maximization with Cardinality Constraints , 2014, SODA.

[40]  M. L. Fisher,et al.  An analysis of approximations for maximizing submodular set functions—I , 1978, Math. Program..

[41]  Lisa Hellerstein,et al.  Approximation Algorithms for Stochastic Boolean Function Evaluation and Stochastic Submodular Set Cover , 2013, SODA.