Convergence Analysis for Distributionally Robust Optimization and Equilibrium Problems

In this paper, we study distributionally robust optimization approaches for a one-stage stochastic minimization problem, where the true distribution of the underlying random variables is unknown but it is possible to construct a set of probability distributions, which contains the true distribution and optimal decision is taken on the basis of the worst-possible distribution from that set. We consider the case when the distributional set (which is also known as the ambiguity set) varies and its impact on the optimal value and the optimal solutions. A typical example is when the ambiguity set is constructed through samples and we need to look into the impact of increasing the sample size. The analysis provides a unified framework for convergence of some problems where the ambiguity set is approximated in a process with increasing information on uncertainty and extends the classical convergence analysis in stochastic programming. The discussion is extended briefly to a stochastic Nash equilibrium problem where each player takes a robust action on the basis of the worst subjective expected objective values.

[1]  Shie Mannor,et al.  A distributional interpretation of robust optimization , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[2]  Herbert E. Scarf,et al.  A Min-Max Solution of an Inventory Problem , 1957 .

[3]  K. Athreya,et al.  Measure Theory and Probability Theory , 2006 .

[4]  A. Shapiro ON DUALITY THEORY OF CONIC LINEAR PROBLEMS , 2001 .

[5]  Morten Riis,et al.  Applying the minimax criterion in stochastic recourse programs , 2005, Eur. J. Oper. Res..

[6]  Michael Patriksson,et al.  Stochastic mathematical programs with equilibrium constraints , 1999, Oper. Res. Lett..

[7]  Ioana Popescu,et al.  Optimal Inequalities in Probability Theory: A Convex Optimization Approach , 2005, SIAM J. Optim..

[8]  Yongchao Liu Stability and Sensitivity Analysis of Stochastic Programs with Second Order Dominance Constraints , 2010 .

[9]  Diethard Klatte,et al.  On Procedures for Analysing Parametric Optimization Problems , 1982 .

[10]  Dimitris Bertsimas,et al.  Robust game theory , 2006, Math. Program..

[11]  Shao-Jian Qu,et al.  Distributionally robust games with an application to supply chain , 2017, J. Intell. Fuzzy Syst..

[12]  Hailin Sun,et al.  Asymptotic Convergence Analysis for Distributional Robust Optimization and Equilibrium Problems , 2013 .

[13]  Laurent El Ghaoui,et al.  Robust Optimization , 2021, ICORES.

[14]  Melvyn Sim,et al.  Distributionally Robust Optimization and Its Tractable Approximations , 2010, Oper. Res..

[15]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[16]  Donald Goldfarb,et al.  Robust Portfolio Selection Problems , 2003, Math. Oper. Res..

[17]  Alexander Shapiro,et al.  Consistency of Sample Estimates of Risk Averse Stochastic Programs , 2013, Journal of Applied Probability.

[18]  Yinyu Ye,et al.  Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems , 2010, Oper. Res..

[19]  Alexander Shapiro,et al.  Lectures on Stochastic Programming: Modeling and Theory , 2009 .

[20]  M. Morari,et al.  Nonlinear parametric optimization using cylindrical algebraic decomposition , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[21]  Michèle Breton,et al.  Algorithms for the solution of stochastic dynamic minimax problems , 1995, Comput. Optim. Appl..

[22]  Geoffrey J. McLachlan,et al.  Robust mixture modelling using the t distribution , 2000, Stat. Comput..

[23]  M. Breton,et al.  A scenario aggregation algorithm for the solution of stochastic dynamic minimax problems , 1995 .

[24]  Peter W. Glynn,et al.  Likelihood robust optimization for data-driven problems , 2013, Computational Management Science.

[25]  Alexander Shapiro,et al.  On a Class of Minimax Stochastic Programs , 2004, SIAM J. Optim..

[26]  Yongchao Liu,et al.  Stability analysis of stochastic programs with second order dominance constraints , 2013, Math. Program..

[27]  S. Irwin,et al.  The Distribution of Futures Prices: A Test of the Stable Paretian and Mixture of Normals Hypotheses , 1989, Journal of Financial and Quantitative Analysis.

[28]  W. Römisch Stability of Stochastic Programming Problems , 2003 .

[29]  R. Tyrrell Rockafellar,et al.  Variational Analysis , 1998, Grundlehren der mathematischen Wissenschaften.

[30]  J. Dupacová The minimax approach to stochastic programming and an illustrative application , 1987 .

[31]  Alexander Shapiro,et al.  Minimax analysis of stochastic problems , 2002, Optim. Methods Softw..

[32]  A. Shapiro Monte Carlo Sampling Methods , 2003 .

[33]  N. Higham COMPUTING A NEAREST SYMMETRIC POSITIVE SEMIDEFINITE MATRIX , 1988 .

[34]  G. Pflug Stochastic Optimization and Statistical Inference , 2003 .

[35]  Yu. V. Prokhorov Convergence of Random Processes and Limit Theorems in Probability Theory , 1956 .

[36]  Anthony Man-Cho So,et al.  Moment inequalities for sums of random matrices and their applications in optimization , 2011, Math. Program..

[37]  A. Shapiro,et al.  Stochastic mathematical programs with equilibrium constraints, modelling and sample average approximation , 2008 .

[38]  K Fan,et al.  Minimax Theorems. , 1953, Proceedings of the National Academy of Sciences of the United States of America.

[39]  Daniel Kuhn,et al.  Robust Markov Decision Processes , 2013, Math. Oper. Res..

[40]  Christian Hess,et al.  Conditional expectation and martingales of random sets , 1999, Pattern Recognit..

[41]  Masao Fukushima,et al.  Worst-Case Conditional Value-at-Risk with Application to Robust Portfolio Management , 2009, Oper. Res..

[42]  K. Athreya,et al.  Measure Theory and Probability Theory (Springer Texts in Statistics) , 2006 .

[43]  G. Pflug,et al.  Approximations for Probability Distributions and Stochastic Optimization Problems , 2011 .

[44]  J. Dupacová Uncertainties in minimax stochastic programs , 2011 .

[45]  Xuan Vinh Doan,et al.  Models for Minimax Stochastic Linear Optimization Problems with Risk Aversion , 2010, Math. Oper. Res..

[46]  J. Frédéric Bonnans,et al.  Perturbation Analysis of Optimization Problems , 2000, Springer Series in Operations Research.