Wavelet-based 3-phase hybrid SVR model trained with satellite-derived predictors, particle swarm optimization and maximum overlap discrete wavelet transform for solar radiation prediction

Abstract The accurate prediction of global solar radiation (GSR) with remote sensing in metropolitan, regional and remote, yet solar-rich sites, is a core requisite for cleaner energy utilization, monitoring and conversion of renewable energy into usable power. Data-driven models that investigate the feasibility of solar-fueled energies, face challenges in respect to identifying their appropriate input data as such variables may not be available at all sites due to a lack of environmental monitoring system. In this paper, the Moderate Resolution Imaging Spectroradiometer (MODIS) satellite-derived predictors are employed to train three-phase hybrid SVR model for monthly GSR prediction. Firstly, to acquire relevant model input features, MODIS variables are screened with the Particle Swarm Optimization (PSO) algorithm, and secondly, a Gaussian emulation method of sensitivity analysis is incorporated on all screened variables to ascertain their relative role in predicting GSR. To address pertinent issues of non-stationarities, PSO selected variables are decomposed with Maximum Overlap Discrete Wavelet Transformation prior to its incorporation in Support Vector Regression (SVR), constructing a three-phase PSO-W-SVR hybrid model where the hyper-parameters are acquired by evolutionary (i.e., PSO & Genetic Algorithm) and Grid Search methods. Three-phase PSO-W-SVR hybrid model is benchmarked with alternative machine learning models. Thirty-nine model scenarios are formulated: 13 without feature selection (e.g., SVR), 13 with feature selection (e.g., PSO-SVR for two-phase models) and the remainder 13 with feature selection strategy coupled with data decomposition algorithm (e.g., PSO-W-SVR leading to a three-phase model). Metrics such as skill score (RMSESS), root mean square error (RMSE), mean absolute error (MAE), Willmott’s (WI), Legates & McCabe’s ( E 1 ) and Nash–Sutcliffe coefficients ( E N S ) are applied to comprehensively evaluate prescribed models. Empirical results register high performance of three-phase hybrid PSO-W-SVR models, exceeding the prescribed alternative models. High predictive ability evidenced by a low RRMSE and high E1 ascertains PSO-W-SVR hybrid model as considerably favorable in its capability to be enriched by MODIS satellite-derived variables. Maximum Overlap Discrete Wavelet Transform algorithm is also seen to provide resolved patterns in satellite variables, leading to a superior performance compared to the other data-driven model. The research avers that a three-phase hybrid PSO-W-SVR model can be a viable tool to predict GSR using satellite derived data as predictors, and is particularly useful for exploration of renewable energies where satellite footprint are present but regular environmental monitoring systems may be absent.

[1]  Mingyang Li,et al.  Application of MODWT and log-normal distribution model for automatic epilepsy identification , 2017 .

[2]  De-ti Xie,et al.  Estimation of monthly solar radiation from measured temperatures using support vector machines – A case study , 2011 .

[3]  R. Deo,et al.  Forecasting effective drought index using a wavelet extreme learning machine (W-ELM) model , 2017, Stochastic Environmental Research and Risk Assessment.

[4]  Hasmat Malik,et al.  Application of rapid miner in ANN based prediction of solar radiation for assessment of solar energy resource potential of 76 sites in Northwestern India , 2015 .

[5]  Mohammed Mestari,et al.  Short-term solar power forecasting using Support Vector Regression and feed-forward NN , 2017, 2017 15th IEEE International New Circuits and Systems Conference (NEWCAS).

[6]  Ravinesh C. Deo,et al.  Optimization of Windspeed Prediction Using an Artificial Neural Network Compared With a Genetic Programming Model , 2018, Research Anthology on Multi-Industry Uses of Genetic Programming and Algorithms.

[7]  Digby Race,et al.  Power to change: Analysis of household participation in a renewable energy and energy efficiency programme in Central Australia , 2015 .

[8]  Gang Song,et al.  A novel double deep ELMs ensemble system for time series forecasting , 2017, Knowl. Based Syst..

[9]  G. V. Drisya,et al.  Diverse dynamical characteristics across the frequency spectrum of wind speed fluctuations , 2018 .

[10]  Ravi Shankar,et al.  Discrete Wavelet Transform-Based Prediction of Stock Index: A Study on National Stock Exchange Fifty Index , 2015, 1605.07278.

[11]  Ali Al-Alili,et al.  A hybrid solar radiation modeling approach using wavelet multiresolution analysis and artificial neural networks , 2017 .

[12]  J. Nash,et al.  River flow forecasting through conceptual models part I — A discussion of principles☆ , 1970 .

[13]  Jan Adamowski,et al.  Wavelet‐based multiscale performance analysis: An approach to assess and improve hydrological models , 2014 .

[14]  Guoqing Huang,et al.  A novel wind speed prediction method: Hybrid of correlation-aided DWT, LSSVM and GARCH , 2018 .

[15]  Shahaboddin Shamshirband,et al.  Potential of radial basis function based support vector regression for global solar radiation prediction , 2014 .

[16]  Saifur Rahman,et al.  Hour-ahead solar PV power forecasting using SVR based approach , 2017, 2017 IEEE Power & Energy Society Innovative Smart Grid Technologies Conference (ISGT).

[17]  Mehdi Hosseinzadeh Aghdam,et al.  Feature Selection Using Particle Swarm Optimization in Text Categorization , 2015, J. Artif. Intell. Soft Comput. Res..

[18]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[19]  Holger R. Maier,et al.  Input determination for neural network models in water resources applications. Part 1—background and methodology , 2005 .

[20]  Mehmet Şahin,et al.  Erratum to: An extreme learning machine model for the simulation of monthly mean streamflow water level in eastern Queensland , 2016, Environmental Monitoring and Assessment.

[21]  Huan Wang,et al.  PSO-SVR: A Hybrid Short-term Traffic Flow Forecasting Method , 2015, 2015 IEEE 21st International Conference on Parallel and Distributed Systems (ICPADS).

[22]  Jiancheng Sun Modelling of Chaotic Time Series Using Minimax Probability Machine Regression , 2009, 2009 WRI International Conference on Communications and Mobile Computing.

[23]  Waldemar Karwowski,et al.  Predicting the occurrence of adverse events using an adaptive neuro-fuzzy inference system (ANFIS) approach with the help of ANFIS input selection , 2017, Artificial Intelligence Review.

[24]  R. Deo,et al.  Universally deployable extreme learning machines integrated with remotely sensed MODIS satellite predictors over Australia to forecast global solar radiation: A new approach , 2019, Renewable and Sustainable Energy Reviews.

[25]  Adel Mellit,et al.  Prediction of daily and mean monthly global solar radiation using support vector machine in an arid climate , 2016 .

[26]  Andrew T. Walden,et al.  The Maximal Overlap Discrete Wavelet Transform , 2000 .

[27]  Ozgur Kisi,et al.  Applications of hybrid wavelet–Artificial Intelligence models in hydrology: A review , 2014 .

[28]  Jay M. Rosenberger,et al.  Bounds for Optimal Control of a Regional Plug-in Electric Vehicle Charging Station System , 2017, IEEE Transactions on Industry Applications.

[29]  Kasra Mohammadi,et al.  A support vector machine–firefly algorithm-based model for global solar radiation prediction , 2015 .

[30]  Minho Lee,et al.  Fast learning method for convolutional neural networks using extreme learning machine and its application to lane detection , 2017, Neural Networks.

[31]  X. Wen,et al.  A wavelet-coupled support vector machine model for forecasting global incident solar radiation using limited meteorological dataset , 2016 .

[32]  Laurel Saito,et al.  ANFIS, SVM and ANN soft-computing techniques to estimate daily global solar radiation in a warm sub-humid environment , 2017 .

[33]  Rohit Bhakar,et al.  Optimized Support Vector Regression models for short term solar radiation forecasting in smart environment , 2016, 2016 IEEE Region 10 Conference (TENCON).

[34]  David Pozo-Vázquez,et al.  An artificial neural network ensemble model for estimating global solar radiation from Meteosat satellite images , 2013 .

[35]  S. Kahla,et al.  Fuzzy-PSO controller design for maximum power point tracking in photovoltaic system , 2017 .

[36]  Gregory Z. Grudic,et al.  A Formulation for Minimax Probability Machine Regression , 2002, NIPS.

[37]  A. OHagan,et al.  Bayesian analysis of computer code outputs: A tutorial , 2006, Reliab. Eng. Syst. Saf..

[38]  Kevin McNally,et al.  Methodology for global sensitivity analysis of consequence models , 2013 .

[39]  Wenzhi Zhao,et al.  Validation of five global radiation models with measured daily data in China , 2004 .

[40]  F. Guarnieri,et al.  Comparisons between two wavelet functions in extracting coherent structures from solar wind time series , 2009 .

[41]  Luo Dinggui The Application of ANN Realized by MATLAB to Underground Water Quality Assessment , 2004 .

[42]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[43]  Por Lip Yee,et al.  Estimating the diffuse solar radiation using a coupled support vector machine–wavelet transform model , 2016 .

[44]  A. Walden,et al.  Wavelet Methods for Time Series Analysis , 2000 .

[45]  Jianmin He,et al.  Research on the tail risk spillover between shanghai and shenzhen stock markets based on MODWT and time-varying Clayton Copula , 2014 .

[46]  Cort J. Willmott,et al.  On the Evaluation of Model Performance in Physical Geography , 1984 .

[47]  Houbing Song,et al.  Feature selection and multiple kernel boosting framework based on PSO with mutation mechanism for hyperspectral classification , 2017, Neurocomputing.

[48]  Jan Adamowski,et al.  Multiscale streamflow forecasting using a new Bayesian Model Average based ensemble multi-wavelet Volterra nonlinear method , 2013 .

[49]  Vanessa Rauland,et al.  Future business models for Western Australian electricity utilities , 2017 .

[50]  Mohanad S. Al-Musaylh,et al.  Two-phase particle swarm optimized-support vector regression hybrid model integrated with improved empirical mode decomposition with adaptive noise for multiple-horizon electricity demand forecasting , 2018 .

[51]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[52]  Wei Qiao,et al.  Short-term solar power prediction using a support vector machine , 2013 .

[53]  Li Zhu,et al.  MODWT-ARMA model for time series prediction , 2014 .

[54]  Yan Li,et al.  Short-term electricity demand forecasting with MARS, SVR and ARIMA models using aggregated demand data in Queensland, Australia , 2018, Adv. Eng. Informatics.

[55]  X. Wen,et al.  Wavelet analysis–artificial neural network conjunction models for multi-scale monthly groundwater level predicting in an arid inland river basin, northwestern China , 2017 .

[56]  Long Jinlian,et al.  Long and medium term power load forecasting based on a combination model of GMDH, PSO and LSSVM , 2017, 2017 29th Chinese Control And Decision Conference (CCDC).

[57]  Yuntao Han,et al.  A hybrid EMD-SVR model for the short-term prediction of significant wave height , 2016 .

[58]  Gautam Bisht,et al.  Estimation of net radiation from the MODIS data under all sky conditions: Southern Great Plains case study , 2010 .

[59]  Dianhui Wang,et al.  Extreme learning machines: a survey , 2011, Int. J. Mach. Learn. Cybern..

[60]  Iftikhar Ahmad,et al.  Feature Selection Using Particle Swarm Optimization in Intrusion Detection , 2015, Int. J. Distributed Sens. Networks.

[61]  Huanhuan Chen,et al.  Evolving Least Squares Support Vector Machines for Stock Market Trend Mining , 2009, IEEE Trans. Evol. Comput..

[62]  A. Dashti,et al.  H-2-selective mixed matrix membranes modeling using ANFIS, PSO-ANFIS, GA-ANFIS , 2017 .

[63]  Abinet Tesfaye Eseye,et al.  Short-term photovoltaic solar power forecasting using a hybrid Wavelet-PSO-SVM model based on SCADA and Meteorological information , 2018 .

[64]  Youngmin Seo,et al.  River Stage Modeling by Combining Maximal Overlap Discrete Wavelet Transform, Support Vector Machines and Genetic Algorithm , 2017 .

[65]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[66]  S AL-Musaylh Mohanad,et al.  Particle swarm optimized–support vector regression hybrid model for daily horizon electricity demand forecasting using climate dataset , 2018 .

[67]  Abdessamad Kobi,et al.  Design of experiments and statistical process control using wavelets analysis , 2016 .

[68]  Ravinesh C. Deo,et al.  Global solar radiation prediction by ANN integrated with European Centre for medium range weather forecast fields in solar rich cities of Queensland Australia , 2019, Journal of Cleaner Production.

[69]  D. Legates,et al.  Evaluating the use of “goodness‐of‐fit” Measures in hydrologic and hydroclimatic model validation , 1999 .

[70]  R. Deo,et al.  Input selection and performance optimization of ANN-based streamflow forecasts in the drought-prone Murray Darling Basin region using IIS and MODWT algorithm , 2017 .

[71]  Ümmühan Başaran Filik,et al.  Estimation methods of global solar radiation, cell temperature and solar power forecasting: A review and case study in Eskişehir , 2018, Renewable and Sustainable Energy Reviews.

[72]  John Foster,et al.  Australian renewable energy policy: Barriers and challenges , 2013 .

[73]  Mehmet Şahin,et al.  Application of extreme learning machine for estimating solar radiation from satellite data , 2014 .

[74]  Yuan Liu,et al.  Study on network traffic forecast model of SVR optimized by GAFSA , 2016 .

[75]  Feng Liu,et al.  Comparison of boosted regression tree and random forest models for mapping topsoil organic carbon concentration in an alpine ecosystem , 2016 .

[76]  Hao Peng,et al.  Predicting thermal–hydraulic performances in compact heat exchangers by support vector regression , 2015 .

[77]  A. E. Hoerl,et al.  Ridge regression: biased estimation for nonorthogonal problems , 2000 .

[78]  Hadrien Verbois,et al.  Probabilistic forecasting of day-ahead solar irradiance using quantile gradient boosting , 2018, Solar Energy.

[79]  C. Willmott Some Comments on the Evaluation of Model Performance , 1982 .

[80]  Li Pan,et al.  Predicting Short-Term Traffic Flow by Long Short-Term Memory Recurrent Neural Network , 2015, 2015 IEEE International Conference on Smart City/SocialCom/SustainCom (SmartCity).

[81]  Ravinesh C. Deo,et al.  Self-adaptive differential evolutionary extreme learning machines for long-term solar radiation prediction with remotely-sensed MODIS satellite and Reanalysis atmospheric products in solar-rich cities , 2018, Remote Sensing of Environment.

[82]  Jan Adamowski,et al.  Modeling of daily pan evaporation in sub tropical climates using ANN, LS-SVR, Fuzzy Logic, and ANFIS , 2014, Expert Syst. Appl..

[83]  Shengjun Wu,et al.  Assessing the potential of support vector machine for estimating daily solar radiation using sunshine duration , 2013 .

[84]  T. Chai,et al.  Root mean square error (RMSE) or mean absolute error (MAE)? – Arguments against avoiding RMSE in the literature , 2014 .

[85]  Mohammad Rizwan,et al.  Energy management supporting high penetration of solar photovoltaic generation for smart grid using solar forecasts and pumped hydro storage system , 2018 .

[86]  V. Sadasivam,et al.  An integrated PSO for parameter determination and feature selection of ELM and its application in classification of power system disturbances , 2015, Appl. Soft Comput..

[87]  Christian A. Gueymard,et al.  Minimum redundancy – Maximum relevance with extreme learning machines for global solar radiation forecasting: Toward an optimized dimensionality reduction for solar time series , 2017 .

[88]  R. Deo,et al.  Forecasting long-term global solar radiation with an ANN algorithm coupled with satellite-derived (MODIS) land surface temperature (LST) for regional locations in Queensland , 2017 .

[89]  Ching-Hsue Cheng,et al.  A novel GA-SVR time series model based on selected indicators method for forecasting stock price , 2014, 2014 International Conference on Information Science, Electronics and Electrical Engineering.

[90]  Billy M. Williams,et al.  Comparison of parametric and nonparametric models for traffic flow forecasting , 2002 .

[91]  Song Zhou,et al.  Influences of solar energy on the energy efficiency design index for new building ships , 2017 .

[92]  C. W. Tong,et al.  A new hybrid support vector machine–wavelet transform approach for estimation of horizontal global solar radiation , 2015 .

[93]  Philip Weinstein,et al.  The impact of summer temperatures and heatwaves on mortality and morbidity in Perth, Australia 1994-2008. , 2012, Environment international.

[94]  Sancho Salcedo-Sanz,et al.  An efficient neuro-evolutionary hybrid modelling mechanism for the estimation of daily global solar radiation in the Sunshine State of Australia , 2018 .

[95]  B. Huwe,et al.  Uncertainty in the spatial prediction of soil texture: Comparison of regression tree and Random Forest models , 2012 .

[96]  Mohammad Ali Ghorbani,et al.  Multi-layer perceptron hybrid model integrated with the firefly optimizer algorithm for windspeed prediction of target site using a limited set of neighboring reference station data , 2018 .

[97]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[98]  Mengjie Zhang,et al.  Particle swarm optimisation for feature selection in classification: Novel initialisation and updating mechanisms , 2014, Appl. Soft Comput..