Water allocation improvement in river basin using Adaptive Neural Fuzzy Reinforcement Learning approach

An accurate simulation model is a necessary tool for optimizing allocation of scarce water resources in large-scale river basins. Adaptive Neural Fuzzy Inference System (ANFIS) method is used to simulate seven interconnected sub-basins in a regional river system located in Iran. Simulated predictions of the method are compared with historical data measurements. ANFIS is a powerful tool for simulating water resources systems of all sub-basins. In this study, a new methodology, Adaptive Neural Fuzzy Reinforcement Learning (ANFRL) is presented for obtaining optimal values of the decision variables. By combining ANFIS with Fuzzy Reinforcement Learning within the content of historical data over a consecutive monthly management period, ANFRL method was derived. Based upon the results of this research, this methodology can be used to develop fuzzy rule systems that accurately simulate the behavior of complex river basin systems within the context of uncertainty. As previous researches have shown that, when simulation model accurately reproduces observed river basin behavior, the optimization model yields better results. Application of this approach in the present case study shows that the effects of uncertainty, imprecise and random factors are 21, 11 and 15% over water resources system, water demand estimated and hydrological regime, respectively. Finally, the results of this method showed that about 16% improvement in water allocation was attained when compared to the primary water resources management in this case study.

[1]  Ehsanolah Malek-Mohammadi Irrigation Planning: Integrated Approach , 1998 .

[2]  Timothy K. Gates,et al.  Performance Measures for Evaluation of Irrigation‐Water‐Delivery Systems , 1990 .

[3]  Rezaul K. Chowdhury,et al.  Multicriteria decision analysis in water resources management: the malnichara channel improvement , 2008 .

[4]  Timothy K. Gates,et al.  Sensitivity of predicted irrigation-delivery performance to hydraulic and hydrologic uncertainty , 1995 .

[5]  Marnik Vanclooster,et al.  Optimal operation of multipurpose reservoirs using flexible stochastic dynamic programming , 2002, Appl. Soft Comput..

[6]  Vijay K. Minocha,et al.  Fuzzy optimization model for water quality management of a river system - Closure , 1999 .

[7]  Mitsuo Gen,et al.  Fuzzy multiple objective optimal system design by hybrid genetic algorithm , 2003, Appl. Soft Comput..

[8]  Ari Jolma,et al.  Fuzzy Model for Real-Time Reservoir Operation , 2002 .

[9]  John Harris,et al.  An Introduction to Fuzzy Logic Applications , 2000 .

[10]  Timothy K. Gates,et al.  Variability in Perceived Satisfaction of Reservoir Management Objectives , 1997 .

[11]  Wilfried Brauer,et al.  Fuzzy Model-Based Reinforcement Learning , 2002, Advances in Computational Intelligence and Learning.

[12]  Mahmood Javan,et al.  Optimization Model for Allocating Water in a River Basin during a Drought , 2007 .

[13]  Mohammad Karamouz,et al.  Uncertainty based operation of large scale reservoir systems: Dez and Karoon experience , 2003 .

[14]  Thomas P. Minka,et al.  Gates , 2008, NIPS.

[15]  John W. Labadie Combining Simulation and Optimization in River Basin Management , 1993 .

[16]  P. P. Mujumdar,et al.  Grey fuzzy optimization model for water quality management of a river system , 2006 .

[17]  Sung-Kwun Oh,et al.  Self-organizing neural networks with fuzzy polynomial neurons , 2002, Appl. Soft Comput..

[18]  Michio Sugeno,et al.  Fuzzy modeling and control : selected works of M. Sugeno , 1999 .

[19]  Manolis Papadrakakis,et al.  Soft computing methodologies for structural optimization , 2003, Appl. Soft Comput..

[20]  Timothy K. Gates,et al.  Planning Reservoir Operations with Imprecise Objectives , 1997 .

[21]  H. Zimmermann,et al.  Fuzzy Set Theory and Its Applications , 1993 .

[22]  Daniel P. Loucks,et al.  Reliability, resiliency, and vulnerability criteria for water resource system performance evaluation , 1982 .

[23]  Hongxing Li,et al.  Fuzzy Neural Intelligent Systems , 2000 .

[24]  V. Yevjevich,et al.  Stochastic hydrology and its use in water resources systems simulation and optimization , 1993 .

[25]  Richard C. Peralta,et al.  Simulation/Optimization Modeling for Water Resources Management , 1999 .

[26]  Hans-Jürgen Zimmermann,et al.  Fuzzy Set Theory - and Its Applications , 1985 .

[27]  Richard M. Vogel,et al.  Closure to: The optimal allocation of water withdrawals in a river basin , 1998 .

[28]  William W.-G. Yeh,et al.  Reservoir Management and Operations Models: A State‐of‐the‐Art Review , 1985 .

[29]  Mark H. Houck,et al.  Optimization and Simulation of Multiple Reservoir Systems , 1992 .

[30]  Lionel Jouffe,et al.  Fuzzy inference system learning by reinforcement methods , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[31]  Daniel C. Yoder,et al.  Optimization of Fuzzy Evapotranspiration Model Through Neural Training with Input-Output Examples , 2001 .