On Solving Multistage Stochastic Programs with Coherent Risk Measures

We consider a class of multistage stochastic linear programs in which at each stage a coherent risk measure of future costs is to be minimized. A general computational approach based on dynamic programming is derived that can be shown to converge to an optimal policy. By computing an inner approximation to future cost functions, we can evaluate an upper bound on the cost of an optimal policy, and an outer approximation delivers a lower bound. The approach we describe is particularly useful in sampling-based algorithms, and a numerical example is provided to show the efficacy of the methodology when used in conjunction with stochastic dual dynamic programming.

[1]  Alexander Shapiro,et al.  On complexity of multistage stochastic programs , 2006, Oper. Res. Lett..

[2]  Philippe Artzner,et al.  Coherent Measures of Risk , 1999 .

[3]  W. Ziemba,et al.  The Russell-Yasuda Kasai Model: An Asset/Liability Model for a Japanese Insurance Company Using Multistage Stochastic Programming , 1994 .

[4]  Vitor L. de Matos,et al.  Dynamic sampling algorithms for multi-stage stochastic programs with risk aversion , 2012, Eur. J. Oper. Res..

[5]  Alexander Schied,et al.  Convex measures of risk and trading constraints , 2002, Finance Stochastics.

[6]  Alexander Shapiro,et al.  Lectures on Stochastic Programming: Modeling and Theory , 2009 .

[7]  Andrzej Ruszczynski,et al.  Risk-averse dynamic programming for Markov decision processes , 2010, Math. Program..

[8]  Reinaldo Castro Souza,et al.  Stochastic Dynamic Programming Applied to Hydrothermal Power Systems Operation Planning Based on the Convex Hull Algorithm , 2010 .

[9]  M. V. F. Pereira,et al.  Multi-stage stochastic optimization applied to energy planning , 1991, Math. Program..

[10]  Uerj Cepel Cepel,et al.  Chain of Optimization Models for Setting the Energy Dispatch and Spot Price in the Brazilian System M.E.P.Maceira L.A.Terry F.S.Costa J.M.Damázio A.C.G.Melo , 2002 .

[11]  Tito Homem-de-Mello,et al.  Sampling strategies and stopping criteria for stochastic dual dynamic programming: a case study in long-term hydrothermal scheduling , 2011 .

[12]  Yurii Nesterov,et al.  Introductory Lectures on Convex Optimization - A Basic Course , 2014, Applied Optimization.

[13]  Erlon Cristian Finardi,et al.  A computational study of a stochastic optimization model for long term hydrothermal scheduling , 2012 .

[14]  William T. Ziemba,et al.  Applications of Stochastic Programming , 2005 .

[15]  Werner Römisch,et al.  Sampling-Based Decomposition Methods for Multistage Stochastic Programs Based on Extended Polyhedral Risk Measures , 2012, SIAM J. Optim..

[16]  Alexander Shapiro,et al.  Risk neutral and risk averse Stochastic Dual Dynamic Programming method , 2013, Eur. J. Oper. Res..

[17]  Alexander Shapiro,et al.  Analysis of stochastic dual dynamic programming method , 2011, Eur. J. Oper. Res..

[18]  Frank Riedel,et al.  Dynamic Coherent Risk Measures , 2003 .

[19]  Erlon Cristian Finardi,et al.  Improving the performance of Stochastic Dual Dynamic Programming , 2015, J. Comput. Appl. Math..

[20]  William T. Ziemba,et al.  Applications of Stochastic Programming (Mps-Siam Series on Optimization) (Mps-Saimseries on Optimization) , 2005 .

[21]  M.E.P. Maceira,et al.  TEN YEARS OF APPLICATION OF STOCHASTIC DUAL DYNAMIC PROGRAMMING IN OFFICIAL AND AGENT STUDIES IN BRAZIL - DESCRIPTION OF THE NEWAVE PROGRAM , 2008 .

[22]  Alexander Shapiro,et al.  Conditional Risk Mappings , 2005, Math. Oper. Res..

[23]  J. M. Damázio,et al.  Chain of Optimization Models for Setting the Energy Dispatch and Spot Price in the Brazilian System , 2001 .

[24]  J. E. Kelley,et al.  The Cutting-Plane Method for Solving Convex Programs , 1960 .

[25]  Claudia A. Sagastizábal,et al.  Risk-averse feasible policies for large-scale multistage stochastic linear programs , 2013, Math. Program..