Inexact Cuts in Deterministic and Stochastic Dual Dynamic Programming Applied to Linear Optimization Problems

We introduce an extension of Dual Dynamic Programming (DDP) to solve linear dynamic programming equations. We call this extension IDDP-LP which applies to situations where some or all primal and dual subproblems to be solved along the iterations of the method are solved with a bounded error (inexactly). We provide convergence theorems both in the case when errors are bounded and for asymptotically vanishing errors. We extend the analysis to stochastic linear dynamic programming equations, introducing Inexact Stochastic Dual Dynamic Programming for linear programs (ISDDP-LP), an inexact variant of SDDP applied to linear programs corresponding to the situation where some or all problems to be solved in the forward and backward passes of SDDP are solved approximately. We also provide convergence theorems for ISDDP-LP for bounded and asymptotically vanishing errors. Finally, we present the results of numerical experiments comparing SDDP and ISSDP-LP on a portfolio problem with direct transation costs modelled as a multistage stochastic linear optimization problem. On these experiments, for some values of the noises, ISDDP-LP can converge significantly quicker than SDDP.

[1]  Pierre Girardeau,et al.  On the Convergence of Decomposition Methods for Multistage Stochastic Convex Programs , 2015, Math. Oper. Res..

[2]  Werner Römisch,et al.  SDDP for multistage stochastic linear programs based on spectral risk measures , 2012, Oper. Res. Lett..

[3]  Golbon Zakeri,et al.  Inexact Cuts in Benders Decomposition , 1999, SIAM J. Optim..

[4]  Vincent Guigues,et al.  SDDP for some interstage dependent risk-averse problems and application to hydro-thermal planning , 2014, Comput. Optim. Appl..

[5]  John R. Birge,et al.  Decomposition and Partitioning Methods for Multistage Stochastic Linear Programs , 1985, Oper. Res..

[6]  Laurent Pfeiffer,et al.  Two methods of pruning Benders' cuts and their application to the management of a gas portfolio , 2012 .

[7]  Andrew B. Philpott,et al.  On the convergence of stochastic dual dynamic programming and related methods , 2008, Oper. Res. Lett..

[8]  Vincent Guigues.  Convergence Analysis of Sampling-Based Decomposition Methods for Risk-Averse Multistage Stochastic Convex Programs , 2016, SIAM J. Optim..

[9]  Gerd Infanger,et al.  Cut sharing for multistage stochastic linear programs with interstage dependency , 1996, Math. Program..

[10]  Shabbir Ahmed,et al.  Stochastic dual dynamic integer programming , 2019, Math. Program..

[11]  Alexander Shapiro,et al.  Analysis of stochastic dual dynamic programming method , 2011, Eur. J. Oper. Res..

[12]  Alexander Shapiro,et al.  Lectures on Stochastic Programming: Modeling and Theory , 2009 .

[13]  M. V. F. Pereira,et al.  Multi-stage stochastic optimization applied to energy planning , 1991, Math. Program..

[14]  David P. Morton,et al.  Evaluating policies in risk-averse multi-stage stochastic programming , 2014, Mathematical Programming.

[15]  Vincent Guigues.  Inexact cuts for Deterministic and Stochastic Dual Dynamic Programming applied to convex nonlinear optimization problems , 2017 .

[16]  Warren B. Powell,et al.  Regularized Decomposition of High-Dimensional Multistage Stochastic Programs with Markov Uncertainty , 2015, SIAM J. Optim..

[17]  Antonio Alonso Ayuso,et al.  Introduction to Stochastic Programming , 2009 .

[18]  Erlon Cristian Finardi,et al.  Improving the performance of Stochastic Dual Dynamic Programming , 2015, J. Comput. Appl. Math..

[19]  Vincent Guigues,et al.  Multicut decomposition methods with cut selection for multistage stochastic programs , 2017 .

[20]  Vincent Guigues.  Dual Dynamic Programing with cut selection: Convergence proof and numerical experiments , 2017, Eur. J. Oper. Res..

[21]  Jacques F. Benders,et al.  Partitioning procedures for solving mixed-variables programming problems , 2005, Comput. Manag. Sci..

[22]  Werner Römisch,et al.  Sampling-Based Decomposition Methods for Multistage Stochastic Programs Based on Extended Polyhedral Risk Measures , 2012, SIAM J. Optim..