Deep Learning Forecasts of Soil Moisture: Convolutional Neural Network and Gated Recurrent Unit Models Coupled with Satellite-Derived MODIS, Observations and Synoptic-Scale Climate Index Data

Remotely sensed soil moisture forecasting through satellite-based sensors to estimate the future state of the underlying soils plays a critical role in planning and managing water resources and sustainable agricultural practices. In this paper, Deep Learning (DL) hybrid models (i.e., CEEMDANCNN-GRU) are designed for daily time-step surface soil moisture (SSM) forecasts, employing the gated recurrent unit (GRU), complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN), and convolutional neural network (CNN). To establish the objective model’s viability for SSM forecasting at multi-step daily horizons, the hybrid CEEMDAN-CNN-GRU model is tested at 1st, 5th, 7th, 14th, 21st, and 30th day ahead period by assimilating a comprehensive pool of 52 predictor dataset obtained from three distinct data sources. Data comprise satellite-derived Global Land Data Assimilation System (GLDAS) repository a global, high-temporal resolution, unique terrestrial modelling system, and ground-based variables from Scientific Information Landowners (SILO) and synoptic-scale climate indices. The results demonstrate the forecasting capability of the hybrid CEEMDAN-CNN-GRU model with respect to the counterpart comparative models. This is supported by a relatively lower value of the mean absolute percentage and root mean square error. In terms of the statistical score metrics and infographics employed to test the final model’s utility, the proposed CEEMDAN-CNN-GRU models are considerably superior compared to a standalone and other hybrid method tested on independent SSM data developed through feature selection approaches. Thus, the proposed approach can be successfully implemented in hydrology and agriculture management.

[1]  Ravinesh C. Deo,et al.  Deep solar radiation forecasting with convolutional neural network and long short-term memory network algorithms , 2019, Applied Energy.

[2]  Yan Li,et al.  Weekly soil moisture forecasting with multivariate sequential, ensemble empirical mode decomposition and Boruta-random forest hybridizer algorithm approach , 2019, CATENA.

[3]  Germán Castellanos-Domínguez,et al.  Rainfall Forecasting Based on Ensemble Empirical Mode Decomposition and Neural Networks , 2013, IWANN.

[4]  Patrick Flandrin,et al.  A complete ensemble empirical mode decomposition with adaptive noise , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[5]  Grundy The Australian Soil Resource Information System , 2009 .

[6]  Ravinesh C. Deo,et al.  Self-adaptive differential evolutionary extreme learning machines for long-term solar radiation prediction with remotely-sensed MODIS satellite and Reanalysis atmospheric products in solar-rich cities , 2018, Remote Sensing of Environment.

[7]  Yu Zhang,et al.  Investigating spatial and temporal characteristics of harmful Algal Bloom areas in the East China Sea using a fast and flexible method , 2010, 2010 18th International Conference on Geoinformatics.

[8]  Mohammad Arhami,et al.  Predicting hourly air pollutant levels using artificial neural networks coupled with uncertainty analysis by Monte Carlo simulations , 2013, Environmental Science and Pollution Research.

[9]  Wei Hu,et al.  Soil water prediction based on its scale-specific control using multivariate empirical mode decomposition , 2013 .

[10]  Q. Ouyang,et al.  Monthly Rainfall Forecasting Using EEMD-SVR Based on Phase-Space Reconstruction , 2016, Water Resources Management.

[11]  R. Deo,et al.  An extreme learning machine model for the simulation of monthly mean streamflow water level in eastern Queensland , 2016, Environmental Monitoring and Assessment.

[12]  Vahid Nourani,et al.  A Multivariate ANN-Wavelet Approach for Rainfall–Runoff Modeling , 2009 .

[13]  C. Willmott,et al.  A refined index of model performance , 2012 .

[14]  Juan José Pantrigo,et al.  Convolutional Neural Networks and Long Short-Term Memory for skeleton-based human activity and hand gesture recognition , 2018, Pattern Recognit..

[15]  Holger R. Maier,et al.  Input determination for neural network models in water resources applications. Part 1—background and methodology , 2005 .

[16]  Thong Nguyen-Huy,et al.  Copula-statistical precipitation forecasting model in Australia’s agro-ecological zones , 2017 .

[17]  K. P. Sudheer,et al.  Methods used for the development of neural networks for the prediction of water resource variables in river systems: Current status and future directions , 2010, Environ. Model. Softw..

[18]  M. Ye,et al.  Developing a Long Short-Term Memory (LSTM) based model for predicting water table depth in agricultural areas , 2018, Journal of Hydrology.

[19]  Norden E. Huang,et al.  The Multi-Dimensional Ensemble Empirical Mode Decomposition Method , 2009, Adv. Data Sci. Adapt. Anal..

[20]  Karsten Schulz,et al.  Rainfall–runoff modelling using Long Short-Term Memory (LSTM) networks , 2018, Hydrology and Earth System Sciences.

[21]  Giha Lee,et al.  Application of Gated Recurrent Unit (GRU) Network for Forecasting River Water Levels Affected by Tides , 2019, APAC 2019.

[22]  Ozgur Kisi,et al.  Applications of hybrid wavelet–Artificial Intelligence models in hydrology: A review , 2014 .

[23]  D. Legates,et al.  Evaluating the use of “goodness‐of‐fit” Measures in hydrologic and hydroclimatic model validation , 1999 .

[24]  X. Wen,et al.  Design and evaluation of SVR, MARS and M5Tree models for 1, 2 and 3-day lead time forecasting of river flow data in a semiarid mountainous catchment , 2018, Stochastic Environmental Research and Risk Assessment.

[25]  R. Deo,et al.  Forecasting long-term global solar radiation with an ANN algorithm coupled with satellite-derived (MODIS) land surface temperature (LST) for regional locations in Queensland , 2017 .

[26]  S. Mohamed,et al.  Statistical Normalization and Back Propagation for Classification , 2022 .

[27]  Wengang Zheng,et al.  Research on soil moisture prediction model based on deep learning , 2019, PloS one.

[28]  P. Shi,et al.  ENSO, climate variability and crop yields in China , 2013 .

[29]  Mikel González-Eguino,et al.  The socioeconomic future of deltas in a changing environment. , 2019, The Science of the total environment.

[30]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[31]  Ravinesh C. Deo,et al.  Global solar radiation prediction by ANN integrated with European Centre for medium range weather forecast fields in solar rich cities of Queensland Australia , 2019, Journal of Cleaner Production.

[32]  Valerie Trouet,et al.  KNMI Climate Explorer: A Web-Based Research Tool for High-Resolution Paleoclimatology , 2013 .

[33]  Thong Nguyen-Huy,et al.  Modeling the joint influence of multiple synoptic-scale, climate mode indices on Australian wheat yield using a vine copula-based approach , 2018, European Journal of Agronomy.

[34]  Ravinesh C. Deo,et al.  Deep Learning Neural Networks Trained with MODIS Satellite-Derived Predictors for Long-Term Global Solar Radiation Prediction , 2019, Energies.

[35]  A. A. Masrur Ahmed,et al.  Application of artificial neural networks to predict peak flow of Surma River in Sylhet Zone of Bangladesh , 2017 .

[36]  Sungwon Kim,et al.  Hydrological Forecasting Using Hybrid Data-Driven Approach , 2016 .

[37]  Giha Lee,et al.  Application of Long Short-Term Memory (LSTM) Neural Network for Flood Forecasting , 2019, Water.

[38]  Syed Mustakim Ali Shah,et al.  Application of adaptive neuro-fuzzy inference system (ANFIS) to estimate the biochemical oxygen demand (BOD) of Surma River , 2017 .

[39]  Wenzhi Zhao,et al.  Crop evapotranspiration-based irrigation management during the growing season in the arid region of northwestern China , 2015, Environmental Monitoring and Assessment.

[40]  Wei Yang,et al.  Neighborhood Component Feature Selection for High-Dimensional Data , 2012, J. Comput..

[41]  X. Wen,et al.  A wavelet-coupled support vector machine model for forecasting global incident solar radiation using limited meteorological dataset , 2016 .

[42]  S. Philander,et al.  El Niño Southern Oscillation phenomena , 1983, Nature.

[43]  T. Chai,et al.  Root mean square error (RMSE) or mean absolute error (MAE)? – Arguments against avoiding RMSE in the literature , 2014 .

[44]  Xiaochao Wang,et al.  A Four-Stage Hybrid Model for Hydrological Time Series Forecasting , 2014, PloS one.

[45]  Ashish Sharma,et al.  Multi-model drought predictions using temporally aggregated climate indicators , 2020 .

[46]  M. McKee,et al.  SOIL MOISTURE PREDICTION USING SUPPORT VECTOR MACHINES 1 , 2006 .

[47]  Yang Hong,et al.  Assessment of evolving TRMM-based multisatellite real-time precipitation estimation methods and their impacts on hydrologic prediction in a high latitude basin , 2012 .

[48]  Shuo Zhang,et al.  Short-term runoff prediction with GRU and LSTM networks without requiring time step optimization during sample generation , 2020 .

[49]  S. Adarsh,et al.  Scale dependent prediction of reference evapotranspiration based on Multi-Variate Empirical mode decomposition , 2017, Ain Shams Engineering Journal.

[50]  J. Kennedy,et al.  A Tripole Index for the Interdecadal Pacific Oscillation , 2015, Climate Dynamics.

[51]  Oliver Kramer,et al.  Input quality aware convolutional LSTM networks for virtual marine sensors , 2018, Neurocomputing.

[52]  Q. Feng,et al.  LSTM integrated with Boruta-random forest optimiser for soil moisture estimation under RCP4.5 and RCP8.5 global warming scenarios , 2021, Stochastic Environmental Research and Risk Assessment.

[53]  Hoshin Vijai Gupta,et al.  Decomposition of the mean squared error and NSE performance criteria: Implications for improving hydrological modelling , 2009 .

[54]  Quan J. Wang,et al.  Evidence for Using Lagged Climate Indices to Forecast Australian Seasonal Rainfall , 2012 .

[55]  Yan Li,et al.  Ensemble committee-based data intelligent approach for generating soil moisture forecasts with multivariate hydro-meteorological predictors , 2018, Soil and Tillage Research.

[56]  Min Wu,et al.  Two-phase extreme learning machines integrated with the complete ensemble empirical mode decomposition with adaptive noise algorithm for multi-scale runoff prediction problems , 2019, Journal of Hydrology.

[57]  Gregory Leptoukh,et al.  Giovanni: A Web Service Workflow-Based Data Visualization and Analysis System , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[58]  Soroosh Sorooshian,et al.  Short‐Term Precipitation Forecast Based on the PERSIANN System and LSTM Recurrent Neural Networks , 2018, Journal of Geophysical Research: Atmospheres.

[59]  P. R. Julian,et al.  Detection of a 40–50 Day Oscillation in the Zonal Wind in the Tropical Pacific , 1971 .

[60]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[61]  Yan Li,et al.  Soil moisture forecasting by a hybrid machine learning technique: ELM integrated with ensemble empirical mode decomposition , 2018, Geoderma.

[62]  Faisal Hossain,et al.  Understanding the Scale Relationships of Uncertainty Propagation of Satellite Rainfall through a Distributed Hydrologic Model , 2010 .

[63]  R. Deo,et al.  Application of the extreme learning machine algorithm for the prediction of monthly Effective Drought Index in eastern Australia , 2015 .

[64]  J. Nash,et al.  River flow forecasting through conceptual models part I — A discussion of principles☆ , 1970 .

[65]  Ravinesh C. Deo,et al.  Improving SPI-derived drought forecasts incorporating synoptic-scale climate indices in multi-phase multivariate empirical mode decomposition model hybridized with simulated annealing and kernel ridge regression algorithms , 2019, Journal of Hydrology.

[66]  J. Friedman Estimating Functions of Mixed Ordinal and Categorical Variables Using Adaptive Splines , 1991 .

[67]  Norden E. Huang,et al.  Ensemble Empirical Mode Decomposition: a Noise-Assisted Data Analysis Method , 2009, Adv. Data Sci. Adapt. Anal..

[68]  Gints Jekabsons,et al.  Adaptive Regression Splines toolbox for Matlab/Octave , 2015 .

[69]  D. Legates,et al.  A refined index of model performance: a rejoinder , 2013 .

[70]  R. Deo,et al.  Very short‐term reactive forecasting of the solar ultraviolet index using an extreme learning machine integrated with the solar zenith angle , 2017, Environmental research.

[71]  C. Bretherton,et al.  Maximal Overlap Wavelet Statistical Analysis With Application to Atmospheric Turbulence , 2006 .

[72]  R. Deo,et al.  Universally deployable extreme learning machines integrated with remotely sensed MODIS satellite predictors over Australia to forecast global solar radiation: A new approach , 2019, Renewable and Sustainable Energy Reviews.

[73]  A. V. Loon,et al.  Hydrological drought severity explained by climate and catchment characteristics , 2015 .

[74]  Hui Li,et al.  Deep Learning with a Long Short-Term Memory Networks Approach for Rainfall-Runoff Simulation , 2018, Water.

[75]  T. Yamagata,et al.  Impacts of IOD, ENSO and ENSO Modoki on the Australian Winter Wheat Yields in Recent Decades , 2015, Scientific Reports.

[76]  Yongjian Ding,et al.  A New Hybrid Forecasting Approach Applied to Hydrological Data: A Case Study on Precipitation in Northwestern China , 2016 .

[77]  T. McMahon,et al.  El Nino/Southern Oscillation and Australian rainfall, streamflow and drought : Links and potential for forecasting , 1998 .

[78]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[79]  Lin Li,et al.  Research of Soil Moisture Content Forecast Model Based on Genetic Algorithm BP Neural Network , 2010, CCTA.

[80]  Jan Adamowski,et al.  Using extreme learning machines for short-term urban water demand forecasting , 2017 .

[81]  Nikhil Ketkar,et al.  Introduction to Keras , 2017 .

[82]  A. J. Troup,et al.  The ‘southern oscillation’ , 1965 .

[83]  Holger R. Maier,et al.  Neural networks for the prediction and forecasting of water resource variables: a review of modelling issues and applications , 2000, Environ. Model. Softw..

[84]  Emmanouil N. Anagnostou,et al.  Using High-Resolution Satellite Rainfall Products to Simulate a Major Flash Flood Event in Northern Italy , 2013 .

[85]  V. V. Srinivas,et al.  Downscaling of precipitation for climate change scenarios: A support vector machine approach , 2006 .

[86]  J. L. Parra,et al.  Very high resolution interpolated climate surfaces for global land areas , 2005 .

[87]  Luca Brocca,et al.  Soil Moisture for Hydrological Applications: Open Questions and New Opportunities , 2017 .

[88]  X. Wen,et al.  Application of multivariate recursive nesting bias correction, multiscale wavelet entropy and AI-based models to improve future precipitation projection in upstream of the Heihe River, Northwest China , 2019, Theoretical and Applied Climatology.

[89]  C. Fraisse,et al.  ENSO classification indices and summer crop yields in the Southeastern USA , 2011 .

[90]  Luca Brocca,et al.  Spatial‐temporal variability of soil moisture and its estimation across scales , 2010 .

[91]  Wang Hao,et al.  Variable selection methods for water demand forecasting in Ethiopia: Case study Gondar town , 2018 .

[92]  M. Wheeler,et al.  On the Remote Drivers of Rainfall Variability in Australia , 2009 .

[93]  R. Deo,et al.  Input selection and performance optimization of ANN-based streamflow forecasts in the drought-prone Murray Darling Basin region using IIS and MODWT algorithm , 2017 .

[94]  A. A. Masrur Ahmed,et al.  Prediction of dissolved oxygen in Surma River by biochemical oxygen demand and chemical oxygen demand using the artificial neural networks (ANNs) , 2017 .

[95]  R. Deo,et al.  Impact of historical land cover change on daily indices of climate extremes including droughts in eastern Australia , 2009 .

[96]  N. Rehman,et al.  Influence of Natural Forcing Phenomena on Precipitation of Pakistan , 2017 .

[97]  Ahsan Morshed,et al.  Environmental Spatio-temporal Ontology for the Linked Open Data Cloud , 2013, 2013 12th IEEE International Conference on Trust, Security and Privacy in Computing and Communications.

[98]  Jan Adamowski,et al.  Wavelet‐based multiscale performance analysis: An approach to assess and improve hydrological models , 2014 .