Risk-Sensitive Submodular Optimization

The conditional value at risk (CVaR) is a popular risk measure which enables risk-averse decision making under uncertainty. We consider maximizing the CVaR of a continuous submodular function, an extension of submodular set functions to a continuous domain. One example application is allocating a continuous amount of energy to each sensor in a network, with the goal of detecting intrusion or contamination. Previous work allows maximization of the CVaR of a linear or concave function. Continuous submodularity represents a natural set of nonconcave functions with diminishing returns, to which existing techniques do not apply. We give a (1−1/e)-approximation algorithm for maximizing the CVaR of a monotone continuous submodular function. This also yields an algorithm for submodular set functions which produces a distribution over feasible sets with guaranteed CVaR. Experimental results in two sensor placement domains confirm that our algorithm substantially outperforms competitive baselines.

[1]  D. Wu,et al.  Financial and operational decisions in the electricity sector: Contract portfolio optimization with the conditional value-at-risk criterion , 2011 .

[2]  Takanori Maehara,et al.  Risk averse submodular utility maximization , 2015, Oper. Res. Lett..

[3]  Martin Jaggi,et al.  On the Global Linear Convergence of Frank-Wolfe Optimization Variants , 2015, NIPS.

[4]  Shie Mannor,et al.  Policy Gradient for Coherent Risk Measures , 2015, NIPS.

[5]  Jure Leskovec,et al.  Inferring networks of diffusion and influence , 2010, KDD.

[6]  Stefanie Jegelka,et al.  Robust Budget Allocation Via Continuous Submodular Functions , 2017, Applied Mathematics & Optimization.

[7]  Jan Vondrák,et al.  Dependent Randomized Rounding via Exchange Properties of Combinatorial Structures , 2010, 2010 IEEE 51st Annual Symposium on Foundations of Computer Science.

[8]  Efe A. Ok,et al.  The Strategic Advantage of Negatively Interdependent Preferences , 2000, J. Econ. Theory.

[9]  Garud Iyengar,et al.  Fast gradient descent method for Mean-CVaR optimization , 2013, Ann. Oper. Res..

[10]  R. Rockafellar,et al.  Optimization of conditional value-at risk , 2000 .

[11]  Andreas Krause,et al.  Guaranteed Non-convex Optimization: Submodular Maximization over Continuous Domains , 2016, AISTATS.

[12]  Manish Jain,et al.  Risk-Averse Strategies for Security Games with Execution and Observational Uncertainty , 2011, AAAI.

[13]  Jan Vondrák,et al.  Maximizing a Monotone Submodular Function Subject to a Matroid Constraint , 2011, SIAM J. Comput..

[14]  Robert S. Chen,et al.  Robust Optimization for Non-Convex Objectives , 2017, NIPS.

[15]  Shie Mannor,et al.  Risk-Sensitive and Robust Decision-Making: a CVaR Optimization Approach , 2015, NIPS.

[16]  Martin J. Wainwright,et al.  Randomized Smoothing for Stochastic Optimization , 2011, SIAM J. Optim..

[17]  Jan Vondrák,et al.  Optimal approximation for the submodular welfare problem in the value oracle model , 2008, STOC.

[18]  L. Jeff Hong,et al.  Simulating Sensitivities of Conditional Value at Risk , 2009, Manag. Sci..

[19]  Francis Bach,et al.  Submodular functions: from discrete to continuous domains , 2015, Mathematical Programming.

[20]  Mohammad Ghavamzadeh,et al.  Actor-Critic Algorithms for Risk-Sensitive MDPs , 2013, NIPS.

[21]  Andreas Krause,et al.  Cost-effective outbreak detection in networks , 2007, KDD '07.

[22]  Bart Selman,et al.  Risk-Sensitive Policies for Sustainable Renewable Resource Allocation , 2011, IJCAI.

[23]  Yuichi Yoshida,et al.  A Generalization of Submodular Cover via the Diminishing Return Property on the Integer Lattice , 2015, NIPS.

[24]  Thomas Sampson,et al.  Assignment reversals: Trade, skill allocation and wage inequality , 2016, J. Econ. Theory.

[25]  Maria Grazia Speranza,et al.  Conditional value at risk and related linear programming models for portfolio optimization , 2007, Ann. Oper. Res..

[26]  Bryan Wilder,et al.  Equilibrium Computation and Robust Optimization in Zero Sum Games With Submodular Structure , 2017, AAAI.

[27]  Andreas Krause,et al.  Randomized Sensing in Adversarial Environments , 2011, IJCAI.

[28]  Yuichi Yoshida,et al.  Portfolio Optimization for Influence Spread , 2017, WWW.

[29]  Evdokia Nikolova,et al.  Approximately Optimal Risk-Averse Routing Policies via Adaptive Discretization , 2015, AAAI.

[30]  Ben Taskar,et al.  Determinantal Point Processes for Machine Learning , 2012, Found. Trends Mach. Learn..

[31]  Avi Ostfeld,et al.  The Battle of the Water Sensor Networks (BWSN): A Design Challenge for Engineers and Algorithms , 2008 .

[32]  Jia Yuan Yu,et al.  Sample Complexity of Risk-Averse Bandit-Arm Selection , 2013, IJCAI.

[33]  Éva Tardos,et al.  Maximizing the Spread of Influence through a Social Network , 2015, Theory Comput..