An extreme learning machine model for the simulation of monthly mean streamflow water level in eastern Queensland

A predictive model for streamflow has practical implications for understanding the drought hydrology, environmental monitoring and agriculture, ecosystems and resource management. In this study, the state-or-art extreme learning machine (ELM) model was utilized to simulate the mean streamflow water level (QWL) for three hydrological sites in eastern Queensland (Gowrie Creek, Albert, and Mary River). The performance of the ELM model was benchmarked with the artificial neural network (ANN) model. The ELM model was a fast computational method using single-layer feedforward neural networks and randomly determined hidden neurons that learns the historical patterns embedded in the input variables. A set of nine predictors with the month (to consider the seasonality of QWL); rainfall; Southern Oscillation Index; Pacific Decadal Oscillation Index; ENSO Modoki Index; Indian Ocean Dipole Index; and Nino 3.0, Nino 3.4, and Nino 4.0 sea surface temperatures (SSTs) were utilized. A selection of variables was performed using cross correlation with QWL, yielding the best inputs defined by (month; P; Nino 3.0 SST; Nino 4.0 SST; Southern Oscillation Index (SOI); ENSO Modoki Index (EMI)) for Gowrie Creek, (month; P; SOI; Pacific Decadal Oscillation (PDO); Indian Ocean Dipole (IOD); EMI) for Albert River, and by (month; P; Nino 3.4 SST; Nino 4.0 SST; SOI; EMI) for Mary River site. A three-layer neuronal structure trialed with activation equations defined by sigmoid, logarithmic, tangent sigmoid, sine, hardlim, triangular, and radial basis was utilized, resulting in optimum ELM model with hard-limit function and architecture 6-106-1 (Gowrie Creek), 6-74-1 (Albert River), and 6-146-1 (Mary River). The alternative ELM and ANN models with two inputs (month and rainfall) and the ELM model with all nine inputs were also developed. The performance was evaluated using the mean absolute error (MAE), coefficient of determination (r2), Willmott’s Index (d), peak deviation (Pdv), and Nash–Sutcliffe coefficient (ENS). The results verified that the ELM model as more accurate than the ANN model. Inputting the best input variables improved the performance of both models where optimum ELM yielded R2 ≈ (0.964, 0.957, and 0.997), d ≈ (0.968, 0.982, and 0.986), and MAE ≈ (0.053, 0.023, and 0.079) for Gowrie Creek, Albert River, and Mary River, respectively, and optimum ANN model yielded smaller R2 and d and larger simulation errors. When all inputs were utilized, simulations were consistently worse with R2 (0.732, 0.859, and 0.932 (Gowrie Creek), d (0.802, 0.876, and 0.903 (Albert River), and MAE (0.144, 0.049, and 0.222 (Mary River) although they were relatively better than using the month and rainfall as inputs. Also, with the best input combinations, the frequency of simulation errors fell in the smallest error bracket. Therefore, it can be ascertained that the ELM model offered an efficient approach for the streamflow simulation and, therefore, can be explored for its practicality in hydrological modeling.

[1]  J. Nash,et al.  River flow forecasting through conceptual models part I — A discussion of principles☆ , 1970 .

[2]  C. Willmott ON THE VALIDATION OF MODELS , 1981 .

[3]  Douglas G. Fox,et al.  Judging Air Quality Model Performance , 1981 .

[4]  C. Willmott Some Comments on the Evaluation of Model Performance , 1982 .

[5]  N. Nicholls,et al.  Seasonal Relationships between Australian Rainfall and the Southern Oscillation , 1983 .

[6]  Kevin E. Trenberth,et al.  Signal Versus Noise in the Southern Oscillation , 1984 .

[7]  Cort J. Willmott,et al.  On the Evaluation of Model Performance in Physical Geography , 1984 .

[8]  Richard P. Lippmann,et al.  An introduction to computing with neural nets , 1987 .

[9]  R. Lippmann,et al.  An introduction to computing with neural nets , 1987, IEEE ASSP Magazine.

[10]  Thomas A. McMahon,et al.  Global Runoff: Continental Comparisons of Annual Flows and Peak Discharges , 1992 .

[11]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[12]  W. Drosdowsky,et al.  An analysis of Australian seasonal rainfall anomalies: 1950–1987. II: Temporal variability and teleconnection patterns , 1993 .

[13]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[14]  M. Cane,et al.  Annual river discharge in southeastern Australia related to El Nino‐Southern Oscillation forecasts of sea surface temperatures , 1993 .

[15]  Dan W. Patterson,et al.  Artificial Neural Networks: Theory and Applications , 1998 .

[16]  J. Wallace,et al.  ENSO-like Interdecadal Variability: 1900–93 , 1997 .

[17]  J. Wallace,et al.  A Pacific Interdecadal Climate Oscillation with Impacts on Salmon Production , 1997 .

[18]  Neville Nicholls,et al.  Australian rainfall variability and change , 1997 .

[19]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[20]  David William Pearson,et al.  Applications of artificial neural networks , 1998 .

[21]  T. McMahon,et al.  El Nino/Southern Oscillation and Australian rainfall, streamflow and drought : Links and potential for forecasting , 1998 .

[22]  B. Goswami,et al.  A dipole mode in the tropical Indian Ocean , 1999, Nature.

[23]  D. Legates,et al.  Evaluating the use of “goodness‐of‐fit” Measures in hydrologic and hydroclimatic model validation , 1999 .

[24]  S. Power,et al.  Inter-decadal modulation of the impact of ENSO on Australia , 1999 .

[25]  Holger R. Maier,et al.  Neural networks for the prediction and forecasting of water resource variables: a review of modelling issues and applications , 2000, Environ. Model. Softw..

[26]  Michael D. Dettinger,et al.  El Niño and the Southern Oscillation: Multiscale Streamflow Variability Associated with El Niño/Southern Oscillation , 2000 .

[27]  N. Nicholls,et al.  TRENDS IN EXTREME RAINFALL INDICES FOR AN UPDATED HIGH QUALITY DATA SET FOR AUSTRALIA, 1910-1998 , 2000 .

[28]  Michael D. Dettinger,et al.  Global Characteristics of Stream Flow Seasonality and Variability , 2000 .

[29]  S. Franks,et al.  On the identification of ENSO-induced rainfall and runoff variability: a comparison of methods and indices , 2001 .

[30]  Francis H. S. Chiew,et al.  Development of Exceedance Probability Streamflow Forecast , 2001 .

[31]  Francis H. S. Chiew,et al.  Modelling the impacts of climate change on Australian streamflow , 2002 .

[32]  Li-Chiu Chang,et al.  Real‐time recurrent learning neural network for stream‐flow forecasting , 2002 .

[33]  Arif Hepbasli,et al.  Comparison of solar radiation correlations for İzmir, Turkey , 2002 .

[34]  Toshio Yamagata,et al.  Possible impacts of Indian Ocean Dipole mode events on global climate , 2003 .

[35]  T. Yamagata,et al.  Influence of the Indian Ocean Dipole on the Australian winter rainfall , 2003 .

[36]  S. Franks,et al.  Multi‐decadal variability of flood risk , 2003 .

[37]  S. Franks,et al.  Multi‐decadal variability of drought risk, eastern Australia , 2004 .

[38]  S. Franks,et al.  Multidecadal variability of rainfall and streamflow: Eastern Australia , 2004 .

[39]  A. K. Rigler,et al.  Accelerating the convergence of the back-propagation method , 1988, Biological Cybernetics.

[40]  P. Krause,et al.  COMPARISON OF DIFFERENT EFFICIENCY CRITERIA FOR HYDROLOGICAL MODEL ASSESSMENT , 2005 .

[41]  Mac McKee,et al.  Multi-time scale stream flow predictions: The support vector machines approach , 2006 .

[42]  L. Zubair,et al.  Epochal Changes in ENSO-Streamflow Relationships in Sri Lanka , 2006 .

[43]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[44]  Guang-Bin Huang,et al.  Convex incremental extreme learning machine , 2007, Neurocomputing.

[45]  S. Morid,et al.  Drought forecasting using artificial neural networks and time series of drought indices , 2007 .

[46]  Swadhin K. Behera,et al.  El Niño Modoki and its possible teleconnection , 2007 .

[47]  R. Deo,et al.  Modeling the impact of historical land cover change on Australia's regional climate , 2007 .

[48]  T. Yamagata,et al.  Impacts of recent El Niño Modoki on dry/wet conditions in the Pacific rim during boreal summer , 2007 .

[49]  J. Adamowski Development of a short-term river flood forecasting method for snowmelt driven floods based on wavelet and cross-wavelet analysis , 2008 .

[50]  Comparison of daily percentiles of streamflow and rainfall to investigate stream–aquifer connectivity , 2008 .

[51]  M. England,et al.  El Niño Modoki Impacts on Australian Rainfall , 2009 .

[52]  R. Deo,et al.  Impact of historical land cover change on daily indices of climate extremes including droughts in eastern Australia , 2009 .

[53]  M. Wheeler,et al.  On the Remote Drivers of Rainfall Variability in Australia , 2009 .

[54]  R. Deo,et al.  A continent under stress: interactions, feedbacks and risks associated with impact of modified land cover on Australia's climate , 2009 .

[55]  Quan J. Wang,et al.  A Bayesian joint probability modeling approach for seasonal forecasting of streamflows at multiple sites , 2009 .

[56]  W. Cai,et al.  La Niña Modoki impacts Australia autumn rainfall variability , 2009 .

[57]  Muttucumaru Sivakumar,et al.  Evolutionary Modeling for Streamflow Forecasting with Minimal Datasets: A Case Study in the West Malian River, China , 2010 .

[58]  Kwok-Wing Chau,et al.  Data-driven models for monthly streamflow time series prediction , 2010, Eng. Appl. Artif. Intell..

[60]  K. P. Sudheer,et al.  Methods used for the development of neural networks for the prediction of water resource variables in river systems: Current status and future directions , 2010, Environ. Model. Softw..

[61]  Q. J. Wang,et al.  Multisite probabilistic forecasting of seasonal flows for streams with zero value occurrences , 2011 .

[62]  H. D. Trana,et al.  Investigation of artificial neural network models for streamflow forecasting , 2011 .

[63]  Enli Wang,et al.  Monthly and seasonal streamflow forecasts using rainfall‐runoff modeling and historical weather data , 2011 .

[64]  Sou-Sen Leu,et al.  Probabilistic prediction of tunnel geology using a Hybrid Neural-HMM , 2011, Eng. Appl. Artif. Intell..

[65]  M. Paulescu,et al.  A temperature‐based model for global solar irradiance and its application to estimate daily irradiation values , 2011 .

[66]  K. C. Tripathi,et al.  Prediction of Indian summer monsoon rainfall using Niño indices: A neural network approach , 2011 .

[67]  Shamsuddin Shahid Trends in extreme rainfall events of Bangladesh , 2011 .

[68]  J. Abbot,et al.  Application of artificial neural networks to rainfall forecasting in Queensland, Australia , 2012, Advances in Atmospheric Sciences.

[69]  M. Şahin,et al.  Modelling of air temperature using remote sensing and artificial neural network in Turkey , 2012 .

[70]  Sancho Salcedo-Sanz,et al.  Accurate local very short-term temperature prediction based on synoptic situation Support Vector Regression banks , 2012 .

[71]  Anteneh Meshesha Belayneh,et al.  Standard Precipitation Index Drought Forecasting Using Neural Networks, Wavelet Neural Networks, and Support Vector Regression , 2012, Appl. Comput. Intell. Soft Comput..

[72]  Pijush Samui,et al.  Application of support vector machine and relevance vector machine to determine evaporative losses in reservoirs , 2012 .

[73]  J. Adamowski,et al.  Comparison of multiple linear and nonlinear regression, autoregressive integrated moving average, artificial neural network, and wavelet artificial neural network methods for urban water demand forecasting in Montreal, Canada , 2012 .

[74]  M. Masinde Artificial neural networks models for predicting effective drought index: Factoring effects of rainfall variability , 2014, Mitigation and Adaptation Strategies for Global Change.

[75]  M. Imteaz,et al.  Multiple regression and Artificial Neural Network for long-term rainfall forecasting using large scale climate modes , 2013 .

[76]  B. K. Panigrahi,et al.  Development of an artificial neural network based multi-model ensemble to estimate the northeast monsoon rainfall over south peninsular India: an application of extreme learning machine , 2014, Climate Dynamics.

[77]  Yılmaz Kaya,et al.  Comparison of ANN and MLR models for estimating solar radiation in Turkey using NOAA/AVHRR data , 2013 .

[78]  Jan Adamowski,et al.  Urban water demand forecasting and uncertainty assessment using ensemble wavelet‐bootstrap‐neural network models , 2013 .

[79]  Pedro Antonio Gutiérrez,et al.  Simultaneous modelling of rainfall occurrence and amount using a hierarchical nominal-ordinal support vector classifier , 2014, Eng. Appl. Artif. Intell..

[80]  Sancho Salcedo-Sanz,et al.  Feature selection in wind speed prediction systems based on a hybrid coral reefs optimization – Extreme learning machine approach , 2014 .

[81]  Mehmet Şahin,et al.  Application of extreme learning machine for estimating solar radiation from satellite data , 2014 .

[82]  Athanasios G. Paliatsos,et al.  Artificial neural networks modeling for forecasting the maximum daily total precipitation at Athens, Greece , 2014 .

[83]  Wenbin Liu,et al.  Linkages between ENSO/PDO signals and precipitation, streamflow in China during the last 100 years , 2014 .

[84]  J. Abbot,et al.  Input selection and optimisation for monthly rainfall forecasting in Queensland, Australia, using artificial neural networks , 2014 .

[85]  Sancho Salcedo-Sanz,et al.  Accurate precipitation prediction with support vector classifiers: A study including novel predictive variables and observational data , 2014 .

[86]  R. Deo,et al.  Application of the extreme learning machine algorithm for the prediction of monthly Effective Drought Index in eastern Australia , 2015 .

[87]  Ravinesh C. Deo,et al.  Application of the Artificial Neural Network model for prediction of monthly Standardized Precipitation and Evapotranspiration Index using hydrometeorological parameters and climate indices in eastern Australia , 2015 .

[88]  Guang-Bin Huang,et al.  Trends in extreme learning machines: A review , 2015, Neural Networks.

[89]  R. Deo,et al.  Estimation of monthly evaporative loss using relevance vector machine, extreme learning machine and multivariate adaptive regression spline models , 2016, Stochastic Environmental Research and Risk Assessment.

[90]  B. Saavedra-Moreno,et al.  Monthly prediction of air temperature in Australia and New Zealand with machine learning algorithms , 2016, Theoretical and Applied Climatology.