Reinforcement Learning Control for Water-Efficient Agricultural Irrigation

Modern sensor technologies, internet and advanced irrigation equipment allow a relative precise control of agricultural irrigation that leads to high water-use efficiency. However, the core control algorithms that make use of these technologies have not been well studied. In this work, a reinforcement learning based irrigation control technique is investigated. The delayed reward of crop yield is handled by the temporal difference technique. The learning process can be based on both off-line simulation and real data from sensors and crop yield. Neural network based fast models for soil water level and crop yield are developed to improve the scalability of learning. Simulations for various geographic locations and crop types show that the proposed method can significantly increase net return considering both crop yield and water expense.

[1]  Scheduling Irrigation with Computers , 1969 .

[2]  Dennis Wichelns,et al.  Agricultural Water Pricing: United States , 2010 .

[3]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[4]  James W. Jones,et al.  The DSSAT cropping system model , 2003 .

[5]  Alison McCarthy,et al.  Simulation of irrigation control strategies for cotton using Model Predictive Control within the VARIwise simulation framework , 2014 .

[6]  Robin Wardlaw,et al.  Application of genetic algorithms for irrigation water scheduling , 2004 .

[7]  D. M. L. Peña,et al.  Research on automatic irrigation control: State of the art and recent results , 2012 .

[8]  R. G. Evans,et al.  Adoption of site-specific variable rate sprinkler irrigation systems , 2013, Irrigation Science.

[9]  Steven R. Raine,et al.  Advanced process control of irrigation: the current state and an analysis to aid future development , 2011, Irrigation Science.

[10]  Niels Schütze,et al.  Neuro-dynamic programming as a new framework for decision support for deficit irrigation sytems , 2007 .

[11]  Santiago Tosetti,et al.  Neural Network-Based Irrigation Control for Precision Agriculture , 2008, 2008 IEEE International Conference on Networking, Sensing and Control.

[12]  A. R. Sepaskhah,et al.  Use of a water deficit sensitivity index for partial irrigation scheduling of wheat and barley , 1997, Irrigation Science.

[13]  Susan A. O’Shaughnessy,et al.  Grain Sorghum Response to Irrigation Scheduling with the Time-Temperature Threshold Method and Deficit Irrigation Levels , 2012 .

[14]  Terry Allen Howell Optimization of grain sorghum water use efficiency under high frequency irrigation by system simulation and stochastic dynamic programming , 1962 .

[15]  YangQuan Chen,et al.  Iterative Learning Control Approach to a Diffusion Control Problem in an Irrigation Application , 2006, 2006 International Conference on Mechatronics and Automation.

[16]  Paul D. Colaizzi,et al.  WIRELESS SENSOR NETWORK EFFECTIVELY CONTROLS CENTER PIVOT IRRIGATION OF SORGHUM , 2013 .

[17]  Jorge A. Ramírez,et al.  Optimal Stochastic Multicrop Seasonal and Intraseasonal Irrigation Control , 1997 .

[18]  R. G. Evans,et al.  Evaluation of Closed-Loop Site-Specific Irrigation with Wireless Sensor Network , 2009 .

[19]  Yunseop Kim,et al.  Remote Sensing and Control of an Irrigation System Using a Distributed Wireless Sensor Network , 2008, IEEE Transactions on Instrumentation and Measurement.