Fuzzy Sarsa Learning of Operational Instructions to Schedule Water Distribution and Delivery

Operational instructions have a major role in improving water delivery performance in irrigation canals. Of different delivery systems, on-request systems have higher flexibility than rotational ones and can be applied to present irrigation networks with minor changes. The main challenge in on-request systems is determining appropriate operational instructions. The main objective of this paper is formulating a fuzzy Sarsa learning (FSL) system for learning operational instructions. As a result of its properties, including being model free and generalizable, FSL can learn in a limited number of situations and suggest operational instructions for a wide range of conditions. The FSL steps in an irrigation system include present depths observation and flows, selection and execution of the operational instructions, observing new depths and flows, and assigning reward to the applied operational instructions and learning accordingly. The physical and hydraulic data of the East Aghili Canal are used for evaluation of our FSL. The results support the suitability of FSL in terms of performance with respect to generalization and convenience of deployment; the total operation time decreased from 23.1 h in conventional operation to 5.76 h in FSL, the efficiency and adequacy indicators obtained were close to desired values, and water level deviations were less than 10%. Copyright © 2016 John Wiley & Sons, Ltd.

[1]  A. J. Clemmens,et al.  Test Cases for Canal Control Algorithms , 1998 .

[2]  P. Glorennec,et al.  Fuzzy Q-learning , 1997, Proceedings of 6th International Fuzzy Systems Conference.

[3]  M. N. Ahmadabadi,et al.  Fuzzy Sarsa Learning and the proof of existence of its stationary points , 2008 .

[4]  M. Sugeno,et al.  Multi-dimensional fuzzy reasoning , 1983 .

[5]  Timothy K. Gates,et al.  Performance Measures for Evaluation of Irrigation‐Water‐Delivery Systems , 1990 .

[6]  E. Camacho Poyato,et al.  Development of an integrated computational tool to improve performance of irrigation districts , 2012 .

[7]  Y. P. Mathur,et al.  Optimal Operation Scheduling of Irrigation Canals Using Genetic Algorithm , 2009 .

[8]  J. Mohan Reddy,et al.  Improved 0–1 programming model for optimal flow scheduling in irrigation canals , 1995 .

[9]  Robin Wardlaw,et al.  Application of genetic algorithms for irrigation water scheduling , 2004 .

[10]  B. R. Ramesh,et al.  Zero-One Programming Model for Daily Operation Scheduling of Irrigation Canal , 2009 .

[11]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[12]  Y. P. Mathur,et al.  Optimal Reservoir Operation Policies Using Genetic Algorithm , 2009 .

[13]  Robin Wardlaw,et al.  Comparison of Genetic Algorithm and Linear Programming Approaches for Lateral Canal Scheduling , 2004 .

[14]  M J Monem,et al.  Application of simulated annealing (SA) techniques for optimal water distribution in irrigation canals , 2005 .

[15]  C. Santhi,et al.  A new planning model for canal scheduling of rotational irrigation , 2000 .

[16]  Arif A. Anwar,et al.  Irrigation Scheduling Using Mixed-Integer Linear Programming , 2001 .

[17]  Guoqiang Liu,et al.  Transition mode of long distance water delivery project before freezing in winter , 2013 .

[18]  Gilles Belaud,et al.  Optimization of irrigation scheduling for complex water distribution using mixed integer quadratic programming (MIQP) , 2012 .

[19]  D. H. Manz,et al.  Development and application of the irrigation conveyance system simulation model , 1992 .

[20]  Angus R. Simpson,et al.  A genetic algorithm for optimizing off-farm irrigation scheduling , 2001 .