Distributionally robust SDDP

We study a version of stochastic dual dynamic programming (SDDP) with a distributionally robust objective. The classical SDDP algorithm uses a finite (nominal) probability distribution for the random outcomes at each stage. We modify this by defining a distributional uncertainty set in each stage to be a Euclidean neighbourhood of the nominal probability distribution. We derive a formula for the worst-case expectation of future costs over this set that can be applied in the backward pass of SDDP. We verify the correctness of this algorithm, show its almost sure convergence under standard assumptions, and illustrate it by applying it to a model of the New Zealand hydrothermal electricity system.

[1]  Philippe Artzner,et al.  Coherent Measures of Risk , 1999 .

[2]  Güzin Bayraksan,et al.  Data-Driven Stochastic Programming Using Phi-Divergences , 2015 .

[3]  Pierre Girardeau,et al.  On the Convergence of Decomposition Methods for Multistage Stochastic Convex Programs , 2015, Math. Oper. Res..

[4]  Daniel Kuhn,et al.  Data-driven distributionally robust optimization using the Wasserstein metric: performance guarantees and tractable reformulations , 2015, Mathematical Programming.

[5]  Alexander Shapiro,et al.  Analysis of stochastic dual dynamic programming method , 2011, Eur. J. Oper. Res..

[6]  Erlon Cristian Finardi,et al.  Improving the performance of Stochastic Dual Dynamic Programming , 2015, J. Comput. Appl. Math..

[7]  Alan Edelman,et al.  Julia: A Fresh Approach to Numerical Computing , 2014, SIAM Rev..

[8]  Diego Klabjan,et al.  Robust Stochastic Lot-Sizing by Means of Histograms , 2013 .

[9]  Vishal Gupta,et al.  Data-driven robust optimization , 2013, Math. Program..

[10]  Alexander Shapiro,et al.  Lectures on Stochastic Programming: Modeling and Theory , 2009 .

[11]  Yongpei Guan,et al.  A Study of Distributionally Robust Multistage Stochastic Optimization , 2017, 1708.07930.

[12]  M. V. F. Pereira,et al.  Multi-stage stochastic optimization applied to energy planning , 1991, Math. Program..

[13]  Constantine Caramanis,et al.  Theory and Applications of Robust Optimization , 2010, SIAM Rev..

[14]  Iain Dunning,et al.  JuMP: A Modeling Language for Mathematical Optimization , 2015, SIAM Rev..

[15]  Erlon Cristian Finardi,et al.  On Solving Multistage Stochastic Programs with Coherent Risk Measures , 2013, Oper. Res..

[16]  Gerd Infanger,et al.  Cut sharing for multistage stochastic linear programs with interstage dependency , 1996, Math. Program..

[17]  David P. Morton,et al.  Evaluating policies in risk-averse multi-stage stochastic programming , 2014, Mathematical Programming.

[18]  Vitor L. de Matos,et al.  Dynamic sampling algorithms for multi-stage stochastic programs with risk aversion , 2012, Eur. J. Oper. Res..