Long‐term management of a hydroelectric multireservoir system under uncertainty using the progressive hedging algorithm

[1] Among the numerous methods proposed over the past decades for solving reservoir management problems, only a few are applicable on high-dimensional reservoir systems (HDRSs). The progressive hedging algorithm (PHA) was rarely used for managing reservoir systems, but this method is a promising alternative to conventionally used methods for managing HDRSs (e.g., the stochastic dual dynamic programming). The PHA is especially well suited when a new stochastic optimization model must be built upon an existing deterministic optimization model (DOM). In such case, scenario subproblems can be resolved using an existing DOM with minor modifications. In previous studies, the PHA was rarely used and only tested on problems covering short-range planning horizons (2 months with six time periods) where a small number of nonanticipativity constraints (NACs) must be satisfied. Large reservoirs often need to be managed over a much longer planning horizon (1–5 years) containing many tens of time periods. In such case, convergence becomes much more difficult to achieve because of the larger number of NACs to be satisfied. Finding a nonanticipative solution becomes particularly difficult when the input scenarios differ drastically. In this study, we demonstrate the applicability of the PHA for managing HDRSs over long-term (more than a year) horizons in highly uncertain decision environments. We apply the PHA on Hydro-Quebec's reservoir system over a 92 week (period) horizon. We analyze the performance of the PHA for different penalty parameter values. Deterministic solutions are compared to stochastic solutions.

[1]  A. Tilmant,et al.  Assessing marginal water values in multipurpose multireservoir systems via stochastic programming , 2008 .

[2]  Lyn C. Thomas,et al.  An aggregate stochastic dynamic programming model of multireservoir systems , 1997 .

[3]  Marcello Restelli,et al.  Tree‐based reinforcement learning for optimal water reservoir operation , 2010 .

[4]  Erlon Cristian Finardi,et al.  Applying different decomposition schemes using the progressive hedging algorithm to the operation pl , 2012 .

[5]  John W. Labadie,et al.  Optimal Operation of Multireservoir Systems: State-of-the-Art Review , 2004 .

[6]  Quentin Goor,et al.  Optimal Multipurpose-Multireservoir Operation Model with Variable Productivity of Hydropower Plants , 2011 .

[7]  M.E.P. Maceira,et al.  TEN YEARS OF APPLICATION OF STOCHASTIC DUAL DYNAMIC PROGRAMMING IN OFFICIAL AND AGENT STUDIES IN BRAZIL - DESCRIPTION OF THE NEWAVE PROGRAM , 2008 .

[8]  John N. Tsitsiklis,et al.  Neuro-Dynamic Programming , 1996, Encyclopedia of Machine Learning.

[9]  Warren B. Powell,et al.  “Approximate dynamic programming: Solving the curses of dimensionality” by Warren B. Powell , 2007, Wiley Series in Probability and Statistics.

[10]  R. Bellman Dynamic programming. , 1957, Science.

[11]  Ralph A. Wurbs Reservoir‐System Simulation and Optimization Models , 1993 .

[12]  M. V. F. Pereira,et al.  Multi-stage stochastic optimization applied to energy planning , 1991, Math. Program..

[13]  A. Gjelsvik,et al.  Long- and Medium-term Operations Planning and Stochastic Modelling in Hydro-dominated Power Systems Based on Stochastic Dual Dynamic Programming , 2010 .

[14]  André Turgeon,et al.  Stochastic optimization of multireservoir operation: The optimal reservoir trajectory approach , 2005 .

[15]  Stein-Erik Fleten,et al.  Short-term hydropower production planning by stochastic programming , 2008, Comput. Oper. Res..

[16]  Sharon A. Johnson,et al.  The Value of Hydrologic Information in Stochastic Dynamic Programming Models of a Multireservoir System , 1995 .

[17]  Daniele de Rigo,et al.  Neuro-dynamic programming for designing water reservoir network management policies , 2007 .

[18]  Amaury Tilmant,et al.  A stochastic approach to analyze trade‐offs and risks associated with large‐scale water resources systems , 2007 .

[19]  R. Tyrrell Rockafellar,et al.  Scenarios and Policy Aggregation in Optimization Under Uncertainty , 1991, Math. Oper. Res..

[20]  K. D. W. Nandalal,et al.  Dynamic Programming Based Operation of Reservoirs: Applicability and Limits , 2007 .

[21]  Peter K. Kitanidis,et al.  Limitations of Deterministic Optimization Applied to Reservoir Operations , 1999 .

[22]  C. S. Buchanan,et al.  Nested Benders decomposition and dynamic programming for reservoir optimisation , 1999, J. Oper. Res. Soc..

[23]  Jery R. Stedinger,et al.  SOCRATES: A system for scheduling hydroelectric generation under uncertainty , 1995, Ann. Oper. Res..

[24]  William W.-G. Yeh,et al.  Reservoir Management and Operations Models: A State‐of‐the‐Art Review , 1985 .

[25]  Jin-Hee Lee,et al.  Stochastic optimization of multireservoir systems via reinforcement learning , 2007 .

[26]  S. Yakowitz Dynamic programming applications in water resources , 1982 .

[27]  M.E.P. Maceira,et al.  A Four-Dimensional Model of Hydro Generation for the Short-Term Hydrothermal Dispatch Problem Considering Head and Spillage Effects , 2008, IEEE Transactions on Power Systems.

[28]  Deepti Rani,et al.  Simulation–Optimization Modeling: A Survey and Potential Application in Reservoir Systems Operation , 2010 .

[29]  A. Gjelsvik,et al.  Stochastic dual dynamic programming for seasonal scheduling in the Norwegian power system , 1992 .

[30]  Claudia A. Sagastizábal,et al.  Divide to conquer: decomposition methods for energy optimization , 2012, Mathematical Programming.

[31]  A. Turgeon,et al.  An aggregation‐disaggregation approach to long‐term reservoir management , 1998 .