Lake Water-Level fluctuations forecasting using Minimax Probability Machine Regression, Relevance Vector Machine, Gaussian Process Regression, and Extreme Learning Machine

Forecasting freshwater lake levels is vital information for water resource management, including water supply management, shoreline management, hydropower generation optimization, and flood management. This study presents a novel application of four advanced artificial intelligence models namely the Minimax Probability Machine Regression (MPMR), Relevance Vector Machine (RVM), Gaussian Process Regression (GPR) and Extreme Learning Machine (ELM) for forecasting lake level fluctuation in Lake Huron utilizing historical datasets. The MPMR is a probabilistic framework that employed Mercer Kernels to achieve nonlinear regression models. The GPR, which is a probabilistic technique used tractable Bayesian framework for generalization of multivariate distribution of input samples to vast dimensional space. The ELM is a capable algorithm-based model for the implementation of the single-layer feed-forward neural network. The RVM demonstrate depends on the specification of the Bayesian method on a linear model with proper preceding that results in demonstration of sparse. The recommended techniques were tested to evaluate the current lake water-level trend monthly from the historical datasets at four previous time steps. The Lake Huron levels from 1918 to 1993 was managed for the training phase, and the rest of data (from 1994 to 2013) was used for testing. Considering the monthly and annually previous time steps, six models were introduced and found that the best results are achieved for a model with (t-1, t-2, t-3, t-12) as input combinations. The results show that all models can forecast the lake levels precisely. The results of this research study exhibit that the MPMR model (R2 = 0.984; MAE = 0.035; RMSE = 0.044; ENS = 0.984; DRefined = 0.995; ELM = 0.874) found to be more precise in lake level forecasting. The MPMR can be utilized as a practical computational tool on current and future planning with sustainable management of water resource of Lake Michigan-Huron.

[1]  Zaher Mundher Yaseen,et al.  Rainfall Pattern Forecasting Using Novel Hybrid Intelligent Model Based ANFIS-FFA , 2017, Water Resources Management.

[2]  Bahram Gharabaghi,et al.  Reservoir water level forecasting using group method of data handling , 2018, Acta Geophysica.

[3]  Quanxi Shao,et al.  A new trend analysis for seasonal time series with consideration of data dependence , 2011 .

[4]  George Eastman House,et al.  Sparse Bayesian Learning and the Relevan e Ve tor Ma hine , 2001 .

[5]  Mohammad Ali Ghorbani,et al.  Application of firefly algorithm-based support vector machines for prediction of field capacity and permanent wilting point , 2017 .

[6]  Punyaphol Horata,et al.  Robust extreme learning machine , 2013, Neurocomputing.

[7]  Peter Bridgewater,et al.  Nitrous oxide emission from the littoral zones of the Miyun Reservoir near Beijing, China , 2015 .

[8]  Chee Kheong Siew,et al.  Universal Approximation using Incremental Constructive Feedforward Networks with Random Hidden Nodes , 2006, IEEE Transactions on Neural Networks.

[9]  J. Klaus,et al.  Recent climate trends and implications for water resources in the Catskill Mountain region, New York, USA , 2007 .

[10]  Bahram Gharabaghi,et al.  Novel hybrid linear stochastic with non-linear extreme learning machine methods for forecasting monthly rainfall a tropical climate. , 2018, Journal of environmental management.

[11]  Ozgur Kisi,et al.  Lake Level Forecasting Using Wavelet-SVR, Wavelet-ANFIS and Wavelet-ARMA Conjunction Models , 2015, Water Resources Management.

[12]  Ahmed El-Shafie,et al.  Multi-lead ahead prediction model of reference evapotranspiration utilizing ANN with ensemble procedure , 2013, Stochastic Environmental Research and Risk Assessment.

[13]  Pijush Samui,et al.  Forecasting Evaporative Loss by Least-Square Support-Vector Regression and Evaluation with Genetic Programming, Gaussian Process, and Minimax Probability Machine Regression: Case Study of Brisbane City , 2017 .

[14]  Bahram Gharabaghi,et al.  Closure to “An integrated framework of extreme learning machines for predicting scour at pile groups in clear water condition” by: I. Ebtehaj, H. Bonakdari, F. Moradi, B. Gharabaghi, Z. Sheikh Khozani , 2019, Coastal Engineering.

[15]  P. Krause,et al.  COMPARISON OF DIFFERENT EFFICIENCY CRITERIA FOR HYDROLOGICAL MODEL ASSESSMENT , 2005 .

[16]  Özgür Kisi,et al.  Forecasting daily lake levels using artificial intelligence approaches , 2012, Comput. Geosci..

[17]  C. Willmott,et al.  Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance , 2005 .

[18]  Peter Cheeseman,et al.  Bayesian Methods for Adaptive Models , 2011 .

[19]  Khaled H. Hamed Trend detection in hydrologic data: The Mann–Kendall trend test under the scaling hypothesis , 2008 .

[20]  J. Nash,et al.  River flow forecasting through conceptual models part I — A discussion of principles☆ , 1970 .

[21]  Zaher Mundher Yaseen,et al.  Novel approach for streamflow forecasting using a hybrid ANFIS-FFA model , 2017 .

[22]  Stamatios N. Sotiropoulos,et al.  Non-parametric representation and prediction of single- and multi-shell diffusion-weighted MRI data using Gaussian processes , 2015, NeuroImage.

[23]  Michael E. Tipping The Relevance Vector Machine , 1999, NIPS.

[24]  Hossein Bonakdari,et al.  Monthly reservoir inflow forecasting using a new hybrid SARIMA genetic programming approach , 2017, Journal of Earth System Science.

[25]  Robert J. Abrahart,et al.  HydroTest: A web-based toolbox of evaluation metrics for the standardised assessment of hydrological forecasts , 2007, Environ. Model. Softw..

[26]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[27]  Ozgur Kisi,et al.  A genetic programming technique for lake level modeling , 2014 .

[28]  W. Brinkmann Causes of variability in monthly Great Lakes water supplies and lake levels , 2000 .

[29]  T. Chai,et al.  Root mean square error (RMSE) or mean absolute error (MAE)? – Arguments against avoiding RMSE in the literature , 2014 .

[30]  Xi Chen,et al.  Precipitation and temperature trends for the Southwest China: 1960–2007 , 2010 .

[31]  Hossein Bonakdari,et al.  Sensitivity analysis of the factors affecting the discharge capacity of side weirs in trapezoidal channels using extreme learning machines , 2017 .

[32]  Qi Zhang,et al.  Investigating a complex lake-catchment-river system using artificial neural networks: Poyang Lake (China) , 2015 .

[33]  M. Ghorbani,et al.  Inter-comparison of time series models of lake levels predicted by several modeling strategies , 2014 .

[34]  Hamed Dehghan Banadaki,et al.  Prediction of Urmia Lake Water-Level Fluctuations by Using Analytical, Linear Statistic and Intelligent Methods , 2013, Water Resources Management.

[35]  D. Legates,et al.  Evaluating the use of “goodness‐of‐fit” Measures in hydrologic and hydroclimatic model validation , 1999 .

[36]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[37]  D. Mackay,et al.  Bayesian methods for adaptive models , 1992 .

[38]  Hossein Bonakdari,et al.  Integrated SARIMA with Neuro-Fuzzy Systems and Neural Networks for Monthly Inflow Prediction , 2017, Water Resources Management.

[39]  Hafzullah Aksoy,et al.  Prediction of Water Level using Monthly Lagged Data in Lake Urmia, Iran , 2016, Water Resources Management.

[40]  Lei Chen,et al.  Enhanced random search based incremental extreme learning machine , 2008, Neurocomputing.

[41]  R. Deo,et al.  Forecasting effective drought index using a wavelet extreme learning machine (W-ELM) model , 2017, Stochastic Environmental Research and Risk Assessment.

[42]  Bahram Gharabaghi,et al.  Integrated Markov chains and uncertainty analysis techniques to more accurately forecast floods using satellite signals , 2019, Journal of Hydrology.

[43]  Hakan Tongal,et al.  Comparison of Recurrent Neural Network, Adaptive Neuro-Fuzzy Inference System and Stochastic Models in Eğirdir Lake Level Forecasting , 2010 .

[44]  Amir Hossein Zaji,et al.  Robustness lake water level prediction using the search heuristic-based artificial intelligence methods , 2019 .

[45]  Gregory Z. Grudic,et al.  A Formulation for Minimax Probability Machine Regression , 2002, NIPS.

[46]  Özgür Kisi,et al.  A survey of water level fluctuation predicting in Urmia Lake using support vector machine with firefly algorithm , 2015, Appl. Math. Comput..

[47]  Bahram Gharabaghi,et al.  Developing an AI-based method for river discharge forecasting using satellite signals , 2019, Theoretical and Applied Climatology.

[48]  Todd A. Thompson,et al.  Lake-level Variability and Water Availability in the Great Lakes , 2007 .

[49]  Hossein Bonakdari,et al.  A Comparative Study of Extreme Learning Machines and Support Vector Machines in Prediction of Sediment Transport in Open Channels , 2016 .

[50]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[51]  Ozgur Kisi,et al.  Comparison of Different Data-Driven Approaches for Modeling Lake Level Fluctuations: The Case of Manyas and Tuz Lakes (Turkey) , 2015, Water Resources Management.

[52]  Shahaboddin Shamshirband,et al.  Prediction of Water-Level in the Urmia Lake Using the Extreme Learning Machine Approach , 2016, Water Resources Management.

[53]  Abdüsselam Altunkaynak,et al.  Predicting Water Level Fluctuations in Lake Michigan-Huron Using Wavelet-Expert System Methods , 2014, Water Resources Management.

[54]  Zun-Xiong Liu,et al.  Chaotic Load Series Forecasting Based on MPMR , 2006, 2006 International Conference on Machine Learning and Cybernetics.