Risk-averse risk-constrained optimal control

Multistage risk-averse optimal control problems with nested conditional risk mappings are gaining popularity in various application domains. Risk-averse formulations interpolate between the classical expectation-based stochastic and minimax optimal control. This way, risk-averse problems aim at hedging against extreme low-probability events without being overly conservative. At the same time, risk-based constraints may be employed either as surrogates for chance (probabilistic) constraints or as a robustification of expectation-based constraints. Such multistage problems, however, have been identified as particularly hard to solve. We propose a decomposition method for such nested problems that allows us to solve them via efficient numerical optimization methods. Alongside, we propose a new form of risk constraints which accounts for the propagation of uncertainty in time.

[1]  Alexander Shapiro,et al.  Lectures on Stochastic Programming: Modeling and Theory , 2009 .

[2]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[3]  R. Rockafellar,et al.  The fundamental risk quadrangle in risk management, optimization and statistical estimation , 2013 .

[4]  Alberto Bemporad,et al.  Distributed solution of stochastic optimal control problems on GPUs , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[5]  Mohammad Ghavamzadeh,et al.  Algorithms for CVaR Optimization in MDPs , 2014, NIPS.

[6]  Panagiotis Patrinos,et al.  An explicit optimal control approach for mean-risk dynamic portfolio allocation , 2007, 2007 European Control Conference (ECC).

[7]  Alexander Shapiro,et al.  Risk neutral and risk averse approaches to multistage renewable investment planning under uncertainty , 2016, Eur. J. Oper. Res..

[8]  Pantelis Sopasakis,et al.  SuperSCS: fast and accurate large-scale conic optimization , 2019, 2019 18th European Control Conference (ECC).

[9]  Werner Römisch,et al.  Scenario tree modeling for multistage stochastic programs , 2009, Math. Program..

[10]  Alexander Shapiro,et al.  Time and Dynamic Consistency of Risk Averse Stochastic Programs , 2016 .

[11]  G. Pflug,et al.  Modeling, Measuring and Managing Risk , 2008 .

[12]  Dimitris Bertsimas,et al.  A Soft Robust Model for Optimization Under Ambiguity , 2010, Oper. Res..

[13]  Amir Ahmadi-Javid,et al.  Entropic Value-at-Risk: A New Coherent Risk Measure , 2012, J. Optim. Theory Appl..

[14]  Marco Pavone,et al.  A framework for time-consistent, risk-averse model predictive control: Theory and algorithms , 2014, 2014 American Control Conference.

[15]  Siqian Shen Using integer programming for balancing return and risk in problems with individual chance constraints , 2014, Comput. Oper. Res..

[16]  Amir Ahmadi-Javid,et al.  Portfolio optimization with entropic value-at-risk , 2019, Eur. J. Oper. Res..

[17]  Arkadi Nemirovski,et al.  On safe tractable approximations of chance constraints , 2012, Eur. J. Oper. Res..

[18]  Alberto Bemporad,et al.  Risk-averse model predictive control , 2017, Autom..

[19]  Panagiotis Patrinos,et al.  Risk-Averse Model Predictive Operation Control of Islanded Microgrids , 2018, IEEE Transactions on Control Systems Technology.

[20]  Aharon Ben-Tal,et al.  Lectures on modern convex optimization , 1987 .

[21]  Laura Priekule,et al.  Risk-averse stochastic path detection , 2017, Eur. J. Oper. Res..

[22]  Marco Pavone,et al.  A Framework for Time-Consistent, Risk-Sensitive Model Predictive Control: Theory and Algorithms , 2019, IEEE Transactions on Automatic Control.

[23]  Alexander Shapiro,et al.  Convex Approximations of Chance Constrained Programs , 2006, SIAM J. Optim..

[24]  Andrzej Ruszczynski,et al.  Time-consistent approximations of risk-averse multistage stochastic optimization problems , 2015, Math. Program..

[25]  Dimitris Bertsimas,et al.  Constructing Uncertainty Sets for Robust Linear Optimization , 2009, Oper. Res..

[26]  Georg Ch. Pflug,et al.  Dynamic generation of scenario trees , 2015, Computational Optimization and Applications.

[27]  Andrzej Ruszczynski,et al.  Scenario decomposition of risk-averse multistage stochastic programming problems , 2012, Ann. Oper. Res..

[28]  Alberto Bemporad,et al.  GPU-Accelerated Stochastic Predictive Control of Drinking Water Networks , 2016, IEEE Transactions on Control Systems Technology.