The Integration of Nature-Inspired Algorithms with Least Square Support Vector Regression Models: Application to Modeling River Dissolved Oxygen Concentration

The current study investigates an improved version of Least Square Support Vector Machines integrated with a Bat Algorithm (LSSVM-BA) for modeling the dissolved oxygen (DO) concentration in rivers. The LSSVM-BA model results are compared with those obtained using M5 Tree and Multivariate Adaptive Regression Spline (MARS) models to show the efficacy of this novel integrated model. The river water quality data at three monitoring stations located in the USA are considered for the simulation of DO concentration. Eight input combinations of four water quality parameters, namely, water temperature, discharge, pH, and specific conductance, are used to simulate the DO concentration. The results revealed the superiority of the LSSVM-BA model over the M5 Tree and MARS models in the prediction of river DO. The accuracy of the LSSVM-BA model compared with those of the M5 Tree and MARS models is found to increase by 20% and 42%, respectively, in terms of the root-mean-square error. All the predictive models are found to perform best when all the four water quality variables are used as input, which indicates that it is possible to supply more information to the predictive model by way of incorporation of all the water quality variables.

[1]  Ozgur Kisi,et al.  Extreme learning machines: a new approach for modeling dissolved oxygen (DO) concentration with and without water quality variables as predictors , 2017, Environmental Science and Pollution Research.

[2]  Salim Heddam,et al.  Use of Optimally Pruned Extreme Learning Machine (OP-ELM) in Forecasting Dissolved Oxygen Concentration (DO) Several Hours in Advance: a Case Study from the Klamath River, Oregon, USA , 2016, Environmental Processes.

[3]  Antonio Candelieri.  Clustering and Support Vector Regression for Water Demand Forecasting and Anomaly Detection , 2017 .

[4]  Caterina Valeo,et al.  Abiotic influences on dissolved oxygen in a riverine environment , 2011 .

[5]  Zaher Mundher Yaseen,et al.  Rainfall Pattern Forecasting Using Novel Hybrid Intelligent Model Based ANFIS-FFA , 2017, Water Resources Management.

[6]  Alireza Baghban,et al.  Application of a supervised learning machine for accurate prognostication of higher heating values of solid wastes , 2018 .

[7]  Huihui Yu,et al.  Dissolved oxygen content prediction in crab culture using a hybrid intelligent method , 2016, Scientific Reports.

[8]  Giovanni De Marinis,et al.  Machine learning methods for wastewater hydraulics , 2017 .

[9]  Viktor Pocajt,et al.  A linear and non-linear polynomial neural network modeling of dissolved oxygen content in surface water: Inter- and extrapolation performance with inputs' significance analysis. , 2018, The Science of the total environment.

[10]  Junaida Sulaiman,et al.  Heavy Rainfall Forecasting Model Using Artificial Neural Network for Flood Prone Area , 2018 .

[11]  D. Tonina,et al.  Spatial and Temporal Dynamics of Dissolved Oxygen Concentrations and Bioactivity in the Hyporheic Zone , 2018 .

[12]  O. Kisi.  Pan evaporation modeling using least square support vector machine, multivariate adaptive regression splines and M5 model tree , 2015 .

[13]  Salim Heddam,et al.  Modelling hourly dissolved oxygen concentration (DO) using dynamic evolving neural-fuzzy inference system (DENFIS)-based approach: case study of Klamath River at Miller Island Boat Ramp, OR, USA , 2014, Environmental Science and Pollution Research.

[14]  Li Li,et al.  Optimization of Water Resources Utilization by Multi-Objective Moth-Flame Algorithm , 2018, Water Resources Management.

[15]  C. Boyd,et al.  Dissolved Oxygen and Aeration in Ictalurid Catfish Aquaculture , 2018 .

[16]  Julian D. Olden,et al.  Illuminating the “black box”: a randomization approach for understanding variable contributions in artificial neural networks , 2002 .

[17]  Miklas Scholz,et al.  Modeling of Dissolved Oxygen Applying Stepwise Regression and a Template-Based Fuzzy Logic System , 2014 .

[18]  D. Niu,et al.  Comprehensive Evaluation for Operating Efficiency of Electricity Retail Companies Based on the Improved TOPSIS Method and LSSVM Optimized by Modified Ant Colony Algorithm from the View of Sustainable Development , 2018 .

[19]  Y. Bolouri-Yazdeli,et al.  Evaluation of Real-Time Operation Rules in Reservoir Systems Operation , 2014, Water Resources Management.

[20]  Huiru Zhao,et al.  Forecasting Energy-Related CO 2 Emissions Employing a Novel SSA-LSSVM Model: Considering Structural Factors in China , 2018 .

[21]  Zaher Mundher Yaseen,et al.  Application of the Hybrid Artificial Neural Network Coupled with Rolling Mechanism and Grey Model Algorithms for Streamflow Forecasting Over Multiple Time Horizons , 2018, Water Resources Management.

[22]  Özgür Kişi,et al.  Estimation of dissolved oxygen by using neural networks and neuro fuzzy computing techniques , 2017 .

[23]  Chang Liu,et al.  Estimation method for $$\hbox {ET}_{0}$$ET0 with PSO-LSSVM based on the HHT in cold and arid data-sparse area , 2019, Clust. Comput..

[24]  Daoliang Li,et al.  A hybrid WA-CPSO-LSSVR model for dissolved oxygen content prediction in crab culture , 2014, Eng. Appl. Artif. Intell..

[25]  Huihui Yu,et al.  Three-Dimensional Short-Term Prediction Model of Dissolved Oxygen Content Based on PSO-BPANN Algorithm Coupled with Kriging Interpolation , 2016 .

[26]  Mehdi Mehrpooya,et al.  A Comparative Assessment of Predicting Daily Solar Radiation Using Bat Neural Network (BNN), Generalized Regression Neural Network (GRNN), and Neuro-Fuzzy (NF) System: A Case Study , 2018 .

[27]  Daoliang Li,et al.  Prediction of Dissolved Oxygen Content in Aquaculture of Hyriopsis Cumingii Using Elman Neural Network , 2011, CCTA.

[28]  Jianzhuo Yan,et al.  Prediction of water quality time series data based on least squares support vector machine , 2012 .

[29]  V. N. Sharda,et al.  Performance of Multivariate Adaptive Regression Splines (MARS) in predicting runoff in mid-Himalayan micro-watersheds with limited data / Performances de régressions par splines multiples et adaptives (MARS) pour la prévision d'écoulement au sein de micro-bassins versants Himalayens d'altitudes inte , 2008 .

[30]  Saeed Farzin,et al.  Reservoir Optimization for Energy Production Using a New Evolutionary Algorithm Based on Multi-Criteria Decision-Making Models , 2018, Water Resources Management.

[31]  M. Memarianfard,et al.  Application of Gene Expression Programming to water dissolved oxygen concentration prediction , 2017 .

[32]  S. Chapra,et al.  Modelling Dissolved Oxygen Depression in an Urban River in China , 2017 .

[33]  Mahesh Pal,et al.  M5 model tree based modelling of reference evapotranspiration , 2009 .

[34]  Tayfun Dede,et al.  Modeling stream dissolved oxygen concentration using teaching–learning based optimization algorithm , 2015, Environmental Earth Sciences.

[35]  Yonghong Wu,et al.  Grey-related least squares support vector machine optimization model and its application in predicting natural gas consumption demand , 2018, J. Comput. Appl. Math..

[36]  Y. Radhika,et al.  Atmospheric Temperature Prediction using Support Vector Machines , 2009 .

[37]  Y. Liu,et al.  Long-Term Streamflow Forecasting Based on Relevance Vector Machine Model , 2016 .

[38]  Babak Mohammadi,et al.  Pan evaporation prediction using a hybrid multilayer perceptron-firefly algorithm (MLP-FFA) model: case study in North Iran , 2018, Theoretical and Applied Climatology.

[39]  Hanbo Zheng,et al.  A novel model based on wavelet LS-SVM integrated improved PSO algorithm for forecasting of dissolved gas contents in power transformers , 2018 .

[40]  Ozgur Kisi,et al.  Modelling daily dissolved oxygen concentration using least square support vector machine, multivariate adaptive regression splines and M5 model tree , 2018 .

[41]  Curtis B. Barrett.  Long-Term Streamflow Forecasting , 1999 .

[42]  J. Hallstrom,et al.  Monitoring spatial and temporal variation of dissolved oxygen and water temperature in the Savannah River using a sensor network , 2018, Environmental Monitoring and Assessment.

[43]  Mohammad Ali Ahmadi,et al.  A proposed model to predict thermal conductivity ratio of Al2O3/EG nanofluid by applying least squares support vector machine (LSSVM) and genetic algorithm as a connectionist approach , 2018, Journal of Thermal Analysis and Calorimetry.

[44]  B A Cox,et al.  A review of dissolved oxygen modelling techniques for lowland rivers. , 2003, The Science of the total environment.

[45]  Jian Sha,et al.  A comparative study of multiple linear regression, artificial neural network and support vector machine for the prediction of dissolved oxygen , 2017 .

[46]  Zaher Mundher Yaseen,et al.  Novel approach for streamflow forecasting using a hybrid ANFIS-FFA model , 2017 .

[47]  A. A. Masrur Ahmed,et al.  Prediction of dissolved oxygen in Surma River by biochemical oxygen demand and chemical oxygen demand using the artificial neural networks (ANNs) , 2017 .

[48]  Usman T. Khan,et al.  Comparing A Bayesian and Fuzzy Number Approach to Uncertainty Quantification in Short-Term Dissolved Oxygen Prediction , 2017 .

[49]  Jasna Radulović,et al.  Prediction of dissolved oxygen in reservoirs using adaptive network-based fuzzy inference system , 2012 .

[50]  Gerrit Hoogenboom,et al.  Dewpoint Temperature Prediction Using Artificial Neural Networks , 2008 .

[51]  King Kuok Kuok,et al.  Bat optimisation neural networks for rainfall forecasting: case study for Kuching city , 2019 .

[52]  Mohammad Ali Ghorbani,et al.  Estimation of dissolved oxygen using data-driven techniques in the Tai Po River, Hong Kong , 2015, Environmental Earth Sciences.

[53]  Salim Heddam,et al.  Modeling daily dissolved oxygen concentration using modified response surface method and artificial neural network: a comparative study , 2017, Neural Computing and Applications.

[54]  Taher Rajaee,et al.  Modeling of Dissolved Oxygen Concentration and Its Hysteresis Behavior in Rivers Using Wavelet Transform‐Based Hybrid Models , 2017 .

[55]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[56]  Randy A. Dahlgren,et al.  Prediction of dissolved oxygen concentration in hypoxic river systems using support vector machine: a case study of Wen-Rui Tang River, China , 2017, Environmental Science and Pollution Research.

[57]  F. Granata,et al.  Support Vector Regression for Rainfall-Runoff Modeling in Urban Drainage: A Comparison with the EPA’s Storm Water Management Model , 2016 .

[58]  Mrunalini Shivaji Jadhav,et al.  Water Quality Prediction of Gangapur Reservoir (India) Using LS‐SVM and Genetic Programming , 2015 .

[59]  Ozgur Kisi,et al.  Modeling of Dissolved Oxygen in River Water Using Artificial Intelligence Techniques , 2013 .

[60]  Yanan Li,et al.  Short-term wind speed forecasting based on improved ant colony algorithm for LSSVM , 2018, Cluster Computing.

[61]  Chun Kiat Chang,et al.  Prediction of water quality index in constructed wetlands using support vector machine , 2015, Environmental Science and Pollution Research.

[62]  Salim Heddam,et al.  Modeling hourly dissolved oxygen concentration (DO) using two different adaptive neuro-fuzzy inference systems (ANFIS): a comparative study , 2013, Environmental Monitoring and Assessment.

[63]  Özgür Kisi,et al.  A nonlinear mathematical modeling of daily pan evaporation based on conjugate gradient method , 2016, Comput. Electron. Agric..

[64]  Dimitri P. Solomatine,et al.  Model Induction with Support Vector Machines: Introduction and Applications , 2001 .

[65]  Zaher Mundher Yaseen,et al.  Application of soft computing based hybrid models in hydrological variables modeling: a comprehensive review , 2017, Theoretical and Applied Climatology.

[66]  K. P. Singh,et al.  Support vector machines in water quality management. , 2011, Analytica chimica acta.

[67]  Steven C. Chapra,et al.  QUAL2K: A Modeling Framework for Simulating River and Stream Water Quality , 2004 .

[68]  James J. Fitzpatrick,et al.  Water Quality Analysis Simulation Program (WASP) , 1900 .

[69]  Ozgur Kisi,et al.  Modeling reference evapotranspiration using three different heuristic regression approaches , 2016 .

[70]  Daoliang Li,et al.  Prediction of dissolved oxygen content in river crab culture based on least squares support vector regression optimized by improved particle swarm optimization , 2013 .

[71]  Juan Huan,et al.  Prediction of dissolved oxygen in aquaculture based on EEMD and LSSVM optimized by the Bayesian evidence framework , 2018, Comput. Electron. Agric..

[72]  Qiang Xu,et al.  A WD-GA-LSSVM model for rainfall-triggered landslide displacement prediction , 2018, Journal of Mountain Science.

[73]  G. Esposito,et al.  Machine Learning Algorithms for the Forecasting of Wastewater Quality Indicators , 2017 .

[74]  Ozgur Kisi,et al.  Modeling of Dissolved Oxygen Concentration Using Different Neural Network Techniques in Foundation Creek, El Paso County, Colorado , 2012 .

[75]  V. Singh,et al.  Reservoir operation based on evolutionary algorithms and multi-criteria decision-making under climate change and uncertainty , 2018 .

[76]  H. K. Cigizoglu,et al.  Depth-Integrated Estimation of Dissolved Oxygen in a Lake , 2011 .

[77]  O. Kisi,et al.  Enhancing Long-Term Streamflow Forecasting and Predicting using Periodicity Data Component: Application of Artificial Intelligence , 2016, Water Resources Management.

[78]  D. Papamichail,et al.  Cascade Correlation Artificial Neural Networks for Estimating Missing Monthly Values of Water Quality Parameters in Rivers , 2007 .

[79]  Salim Heddam,et al.  Generalized regression neural network (GRNN)-based approach for colored dissolved organic matter (CDOM) retrieval: case study of Connecticut River at Middle Haddam Station, USA , 2014, Environmental Monitoring and Assessment.

[80]  Mogeeb A. A. Mosleh,et al.  Dissolved Oxygen Prediction Using Support Vector Machine , 2014 .