Distributionally robust optimization with polynomial densities: theory, models and algorithms

In distributionally robust optimization the probability distribution of the uncertain problem parameters is itself uncertain, and a fictitious adversary, e.g., nature, chooses the worst distribution from within a known ambiguity set . A common shortcoming of most existing distributionally robust optimization models is that their ambiguity sets contain pathological discrete distributions that give nature too much freedom to inflict damage. We thus introduce a new class of ambiguity sets that contain only distributions with sum-of-squares (SOS) polynomial density functions of known degrees. We show that these ambiguity sets are highly expressive as they conveniently accommodate distributional information about higher-order moments, conditional probabilities, conditional moments or marginal distributions. Exploiting the theoretical properties of a measure-based hierarchy for polynomial optimization due to Lasserre (SIAM J Optim 21(3):864–885, 2011 ), we prove that certain worst-case expectation constraints are polynomial-time solvable under these new ambiguity sets. We also show how SOS densities can be used to approximately solve the general problem of moments . We showcase the applicability of the proposed approach in the context of a stylized portfolio optimization problem and a risk aggregation problem of an insurance company.

[1]  Daniel Kuhn,et al.  A distributionally robust perspective on uncertainty quantification and chance constrained programming , 2015, Mathematical Programming.

[2]  Herbert E. Scarf,et al.  A Min-Max Solution of an Inventory Problem , 1957 .

[3]  Eduardo S. Zeron,et al.  Solving a class of multivariate integration problems via Laplace techniques , 2001 .

[4]  Gene H. Golub,et al.  Matrix computations , 1983 .

[5]  Daniel Kuhn,et al.  Generalized Gauss inequalities via semidefinite programming , 2015, Mathematical Programming.

[6]  H. M. Möller,et al.  Invariant Integration Formulas for the n-Simplex by Combinatorial Methods , 1978 .

[7]  Ioana Popescu,et al.  A Semidefinite Programming Approach to Optimal-Moment Bounds for Convex Classes of Distributions , 2005, Math. Oper. Res..

[8]  Ioana Popescu,et al.  On the Relation Between Option and Stock Prices: A Convex Optimization Approach , 2002, Oper. Res..

[9]  Jia Yuan Yu,et al.  Data-driven Distributionally Robust Polynomial Optimization , 2013, NIPS.

[10]  J Figueira,et al.  Stochastic Programming , 1998, J. Oper. Res. Soc..

[11]  Dimitri P. Bertsekas,et al.  Convex Optimization Theory , 2009 .

[12]  W. Rogosinski Moments of non-negative mass , 1958, Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences.

[13]  Etienne de Klerk,et al.  Comparison of Lasserre's Measure-Based Bounds for Polynomial Optimization to Bounds Obtained by Simulated Annealing , 2018, Math. Oper. Res..

[14]  Daniel Kuhn,et al.  Distributionally Robust Convex Optimization , 2014, Oper. Res..

[15]  Javier Peña,et al.  A Conic Programming Approach to Generalized Tchebycheff Inequalities , 2005, Math. Oper. Res..

[16]  Gregory G. Gocek The 1/N Investment Strategy Is Optimal under High Model Ambiguity , 2012 .

[17]  Jean Lasserre The K-moment problem for continuous linear functionals , 2011 .

[18]  Daniel Kuhn,et al.  Ambiguous Joint Chance Constraints Under Mean and Dispersion Information , 2017, Oper. Res..

[19]  M. Sklar Fonctions de repartition a n dimensions et leurs marges , 1959 .

[20]  Ioana Popescu,et al.  Optimal Inequalities in Probability Theory: A Convex Optimization Approach , 2005, SIAM J. Optim..

[21]  B DantzigGeorge Linear Programming Under Uncertainty , 1955 .

[22]  PopescuIoana A Semidefinite Programming Approach to Optimal-Moment Bounds for Convex Classes of Distributions , 2005 .

[23]  George B. Dantzig,et al.  Linear Programming Under Uncertainty , 2004, Manag. Sci..

[24]  Alexander Shapiro,et al.  Lectures on Stochastic Programming: Modeling and Theory , 2009 .

[25]  Melvyn Sim,et al.  Constructing Risk Measures from Uncertainty Sets , 2009, Oper. Res..

[26]  Yinyu Ye,et al.  Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems , 2010, Oper. Res..

[27]  Etienne de Klerk,et al.  Convergence analysis for Lasserre’s measure-based hierarchy of upper bounds for polynomial optimization , 2017, Math. Program..

[28]  Paul J. Goulart,et al.  Fréchet inequalities via convex optimization , 2016 .

[29]  Etienne de Klerk,et al.  Worst-Case Examples for Lasserre's Measure-Based Hierarchy for Polynomial Optimization on the Hypercube , 2020, Math. Oper. Res..

[30]  Daniel Kuhn,et al.  Data-driven distributionally robust optimization using the Wasserstein metric: performance guarantees and tractable reformulations , 2015, Mathematical Programming.

[31]  Christine M. Anderson-Cook,et al.  Book review: quantitative risk management: concepts, techniques and tools, revised edition, by A.F. McNeil, R. Frey and P. Embrechts. Princeton University Press, 2015, ISBN 978-0-691-16627-8, xix + 700 pp. , 2017, Extremes.

[32]  Melvyn Sim,et al.  Distributionally Robust Optimization and Its Tractable Approximations , 2010, Oper. Res..

[33]  Bowen Li,et al.  Ambiguous risk constraints with moment and unimodality information , 2019, Math. Program..

[34]  Johan Löfberg,et al.  YALMIP : a toolbox for modeling and optimization in MATLAB , 2004 .

[35]  Ronald Cools,et al.  An adaptive numerical cubature algorithm for simplices , 2003, TOMS.

[36]  J. G. Pierce,et al.  Geometric Algorithms and Combinatorial Optimization , 2016 .

[37]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[38]  Jean B. Lasserre,et al.  A semidefinite programming approach to the generalized problem of moments , 2007, Math. Program..

[39]  J. Lasserre,et al.  Representation of distributionally robust chance-constraints , 2018 .

[40]  Jean-Luc Marichal,et al.  Slices, Slabs, and Sections of the Unit Hypercube , 2006 .

[41]  A. Shapiro ON DUALITY THEORY OF CONIC LINEAR PROBLEMS , 2001 .

[42]  Xuan Vinh Doan,et al.  On the Complexity of Nonoverlapping Multivariate Marginal Bounds for Probabilistic Combinatorial Optimization Problems , 2012, Oper. Res..

[43]  Laurent El Ghaoui,et al.  Robust Optimization , 2021, ICORES.

[44]  John R. Birge,et al.  Introduction to Stochastic Programming , 1997 .

[45]  Jean B. Lasserre,et al.  A New Look at Nonnegativity on Closed Sets and Polynomial Optimization , 2010, SIAM J. Optim..

[46]  R. Cont Empirical properties of asset returns: stylized facts and statistical issues , 2001 .

[47]  Xiaobo Li,et al.  Robustness to Dependency in Portfolio Optimization Using Overlapping Marginals , 2015, Oper. Res..

[48]  Jos F. Sturm,et al.  A Matlab toolbox for optimization over symmetric cones , 1999 .

[49]  Anja De Waegenaere,et al.  Robust Solutions of Optimization Problems Affected by Uncertain Probabilities , 2011, Manag. Sci..

[50]  Szilárd Gy. Révész,et al.  On Bernstein and Markov-Type Inequalities for Multivariate Polynomials on Convex Bodies , 1999 .

[51]  Daniel Kuhn,et al.  Distributionally robust multi-item newsvendor problems with multimodal demand distributions , 2014, Mathematical Programming.

[52]  G. Pflug,et al.  Ambiguity in portfolio selection , 2007 .