Water reservoir control under economic, social and environmental constraints

Although great progress has been made in the last 40 years, efficient operation of water reservoir systems still remains a very active research area. The combination of multiple water uses, non-linearities in the model and in the objectives, strong uncertainties in inputs and high dimensional state make the problem challenging and intriguing. The purpose of this paper is to review, in a strict Control Theory perspective, recent and significant advances in designing management policies for water reservoir networks, under economic, social and environmental constraints. A general and thorough problem formulation is provided, along with a description of traditional solution techniques, their limitations and possible alternative approaches.

[1]  Mikiyasu Nakayama,et al.  Development of a web-based decision support system (DSS) for managing large international rivers , 2004 .

[2]  W Rippl,et al.  THE CAPACITY OF STORAGE-RESERVOIRS FOR WATER-SLPPLY. (INCLUDING PLATE). , 1883 .

[3]  Enrico Weber,et al.  SET-VALUED CONTROL LAWS IN TEV-DC CONTROL PROBLEMS , 2002 .

[4]  Haralambos V. Vasiliadis,et al.  DEMAND – DRIVEN OPERATION OF RESERVOIRS USING UNCERTAINTY – BASED OPTIMAL OPERATING POLICIES , 1994 .

[5]  John N. Tsitsiklis,et al.  Neuro-Dynamic Programming , 1996, Encyclopedia of Machine Learning.

[6]  André Turgeon A decomposition method for the long-term scheduling of reservoirs in series , 1981 .

[7]  F. Pianosi,et al.  Extended Ritz Method for Reservoir Management Over an Infinite Horizon , 2008 .

[8]  Sri Lanka,et al.  State-of-the-Art Report on Systems Analysis Methods for Resolution of Conflicts in Water Resources Management , 2002 .

[9]  Giorgio Guariso,et al.  Decision support systems for water management: The Lake Como case study☆ , 1985 .

[10]  Sh. Momtahen,et al.  Direct Search Approaches Using Genetic Algorithms for Optimization of Water Reservoir Operating Policies , 2007 .

[11]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[12]  John N. Tsitsiklis,et al.  Feature-based methods for large scale dynamic programming , 2004, Machine Learning.

[13]  Augustine O. Esogbue,et al.  Dynamic Programming for Optimal Water Resource Systems Analysis , 1989 .

[14]  David G. Luenberger,et al.  Reducing the Memory Requirements of Dynamic Programming , 1968, Oper. Res..

[15]  Stuart E. Dreyfus,et al.  Applied Dynamic Programming , 1965 .

[16]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Stochastic Control , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[17]  Theodor J. Stewart,et al.  Object-oriented decision support system modelling for multicriteria decision making in natural resource management , 2004, Comput. Oper. Res..

[18]  S. Rinaldi,et al.  A min-max approach to storage control problems , 1983 .

[19]  N. Buras,et al.  The dynamic programming approach to water‐resources development , 1961 .

[20]  Andrea Emilio Rizzoli,et al.  TwoLe: a software tool for planning and management of water reservoir networks , 1999 .

[21]  Enrico Weber,et al.  Set-valued control laws in minmax control problem , 2002 .

[22]  David Q. Mayne,et al.  Constrained model predictive control: Stability and optimality , 2000, Autom..

[23]  R. Soncini-Sessa,et al.  Remarks on the application of a risk-averse approach to the management of ‘El Carrizal’ reservoir , 1990 .

[24]  P. Kitanidis,et al.  Gradient dynamic programming for stochastic optimal control of multidimensional water resources systems , 1988 .

[25]  David G. Luenberger,et al.  Technical Note - Cyclic Dynamic Programming: A Procedure for Problems with Fixed Delay , 1971, Oper. Res..

[26]  Carlo Piccardi,et al.  Infinite-horizon periodic minimax control problem , 1993 .

[27]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[28]  Wcd Dams and development: A new framework for decision-making , 2000 .

[29]  Daniele de Rigo,et al.  Neuro-dynamic programming for designing water reservoir network management policies , 2007 .

[30]  A. Castelletti,et al.  Lexicographic optimisation for water resources planning: the case of Lake Verbano, Italy , 2002 .

[31]  Andrea Castelletti,et al.  Topics on System Analysis and Integrated Water Resource Management , 2006 .

[32]  Veena Sharma,et al.  Optimal multi-reservoir network control by two-phase neural network , 2004 .

[33]  R. Bellman Dynamic programming. , 1957, Science.

[34]  A. Turgeon,et al.  Learning disaggregation technique for the operation of long‐term hydroelectric power systems , 1994 .

[35]  Matthew J. Kotchen,et al.  Environmental Constraints on Hydropower: An Ex Post Benefit-Cost Analysis of Dam Relicensing in Michigan , 2006, Land Economics.

[36]  Henning Rasmussen,et al.  Valuation and Optimal Operation of Electric Power Plants in Competitive Markets , 2004, Oper. Res..

[37]  D. H. Marks,et al.  A New Method for the Real-Time Operation of Reservoir Systems , 1987 .

[38]  R. Bellman,et al.  Polynomial approximation—a new computational technique in dynamic programming: Allocation processes , 1963 .

[39]  Sharon A. Johnson,et al.  The Value of Hydrologic Information in Stochastic Dynamic Programming Models of a Multireservoir System , 1995 .

[40]  Carlo Piccardi,et al.  Stochastic dynamic programming for reservoir optimal control: Dense discretization and inflow correlation assumption made possible by parallel computing , 1991 .

[41]  R. Soncini-Sessa,et al.  A decomposition approach to suboptimal control of discrete-time systems , 1994 .

[42]  Alain Haurie,et al.  Efficient management of interconnected power systems: A game-theoretic approach , 1978, Autom..

[43]  Cristiano Cervellera,et al.  Optimization of a large-scale water reservoir network by stochastic dynamic programming with efficient state space discretization , 2006, Eur. J. Oper. Res..

[44]  D. White,et al.  Dynamic programming, Markov chains, and the method of successive approximations , 1963 .

[45]  L. Brown,et al.  How water scarcity will shape the new century. , 2001, Water science and technology : a journal of the International Association on Water Pollution Research.

[46]  Miguel A. Mariño,et al.  RESERVOIR OPERATION BY ANT COLONY OPTIMIZATION ALGORITHMS , 2006 .

[47]  Philip M. Fearnside,et al.  GREENHOUSE GAS EMISSIONS FROM HYDROELECTRIC DAMS: CONTROVERSIES PROVIDE A SPRINGBOARD FOR RETHINKING A SUPPOSEDLY "CLEAN" ENERGY SOURCE , 2004 .

[48]  Daniele de Rigo,et al.  On-line design of water reservoir policies based on inflow prediction , 2008 .

[49]  William W.-G. Yeh,et al.  Reservoir Management and Operations Models: A State‐of‐the‐Art Review , 1985 .

[50]  Andrea Castelletti,et al.  A procedural approach to strengthening integration and participation in water resource planning , 2006, Environ. Model. Softw..

[51]  Alexander V. Lotov,et al.  Interactive Decision Maps: Approximation and Visualization of Pareto Frontier , 2004 .

[52]  J. Quadrat,et al.  Contribution of stochastic control singular perturbation averaging and team theories to an example of large-scale systems: Management of hydropower production , 1978 .

[53]  William S. Butcher,et al.  Optimization of the Operation of a Multiple‐Purpose Reservoir by Dynamic Programming , 1968 .

[54]  Aris P. Georgakakos,et al.  Optimal Stochastic Operation of Salt River Project, Arizona , 1991 .

[55]  P. Kitanidis,et al.  Real‐time forecasting and daily operation of a multireservoir system during floods by linear quadratic Gaussian control , 1983 .

[56]  Peter Dayan,et al.  Technical Note: Q-Learning , 2004, Machine Learning.

[57]  Andrea Castelletti,et al.  Integrated and Participatory Water Resources Management. Theory , 2007 .

[58]  Sanjeev Khagram,et al.  Dams and Development: Transnational Struggles for Water and Power , 1999 .

[59]  K. Fang,et al.  Number-theoretic methods in statistics , 1993 .

[60]  Rolf A. Deininger,et al.  Generalization of White's Method of Successive Approximations to Periodic Markovian Decision Processes , 1972, Oper. Res..

[61]  Dennis McLaughlin,et al.  Real‐time control of a system of large hydropower reservoirs , 1990 .

[62]  M. Sniedovich Reliability‐constrained reservoir control problems: 1. Methodological issues , 1979 .

[63]  Cristiano Cervellera,et al.  Deterministic design for neural network learning: an approach based on discrepancy , 2004, IEEE Transactions on Neural Networks.

[64]  V. T. Chow,et al.  Discrete Differential Dynamic Programing Approach to Water Resources Systems Optimization , 1971 .

[65]  A. Georgakakos Extended linear quadratic Gaussian control: Further extensions , 1989 .

[66]  A. Turgeon Optimal operation of multireservoir power systems with stochastic inflows , 1980 .

[67]  Lucien Duckstein,et al.  Linear quadratic dynamic programming for water reservoir management , 1997 .

[68]  Luiz Pinguelli Rosa,et al.  Greenhouse Gas Emissions from Hydroelectric Reservoirs in Tropical Regions , 2004 .

[69]  W. Rippl The capacity of storage reservoirs for water supply , 1883 .

[70]  Ying Li,et al.  Numerical Solution of Continuous-State Dynamic Programs Using Linear and Spline Interpolation , 1993, Oper. Res..

[71]  Thomas E. Croley,et al.  Application of a distributed large basin runoff model in the Great Lakes basin , 2007 .

[72]  W. Trott,et al.  Optimization of Multiple Reservoir System , 1973 .

[73]  Harald Niederreiter,et al.  Random number generation and Quasi-Monte Carlo methods , 1992, CBMS-NSF regional conference series in applied mathematics.

[74]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[75]  Philip M. Fearnside,et al.  Greenhouse Gas Emissions from Hydroelectric Dams: Controversies Provide a Springboard for Rethinking a Supposedly ‘Clean’ Energy Source. An Editorial Comment , 2004 .

[76]  Rolf A. Deininger,et al.  Modeling the regulation of lake superior under uncertainty of future water supplies , 1974 .

[77]  Robert R. Inman,et al.  Multiobjective dynamic programing with application to a reservoir , 1979 .

[78]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[79]  Lyn C. Thomas,et al.  An aggregate stochastic dynamic programming model of multireservoir systems , 1997 .

[80]  R. Soncini-Sessa,et al.  A Min-Max Approach to Reservoir Management , 1984 .

[81]  R. P. Oliveira,et al.  Operating rules for multireservoir systems , 1997 .

[82]  Dan M. Fults,et al.  Optimum Operations Model for Shasta-Trinity System , 1972 .

[83]  S. Yakowitz Dynamic programming applications in water resources , 1982 .

[84]  M. Sanguineti,et al.  Water reservoirs management under uncertainty by approximating networks and learning from data , 2007 .

[85]  Carlo Piccardi Infinite-horizon minimax control with pointwise cost functional , 1993 .