Short-term wind speed and wind power prediction using hybrid empirical mode decomposition and kernel ridge regression

Abstract This paper presents an efficient non-iterative hybrid empirical mode decomposition (EMD) and kernel ridge regression (KRR) for significantly accurate short-term wind speed and wind power prediction. The original non-linear and non-stationary wind speed and wind power time series data are decomposed using EMD to isolate the mutual effects between different components. The proposed EMD-KRR model is tested for predicting wind speed and wind power time series data over a time horizon spanning intervals of 10 min, 30 min, 1 h and 3 h ahead, respectively. Further the performance of EMD-KRR prediction model is compared with two other widely used non-iterative prediction models like EMD based Random vector functional link network (RVFL), and EMD based Extreme Learning Machine (ELM). Also an iterative Mutated Firefly Algorithm with Global Optima concept (MFAGO) optimized RVFL network is used for comparison to prove the advantages of non-iterative models over the iterative ones. The performance metrics of the proposed EMD-KRR and EMD-RVFL confirm the effectiveness and precision in producing an accurate forecast of both wind speed and wind power in comparison to all other prediction models using the wind power data from three real world wind farms. Further a fast reduced version of the EMD-KRR is presented in the paper to reduce the computational overhead substantially using randomly selected support vectors from the data set while resulting in a reasonably accurate forecast.

[1]  B. Eswara Reddy,et al.  A moving-average filter based hybrid ARIMA-ANN model for forecasting time series data , 2014, Appl. Soft Comput..

[2]  Guang-Bin Huang,et al.  Extreme learning machine: a new learning scheme of feedforward neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[3]  Bo Zhao,et al.  Short-Term Wind Power Forecasting Using Empirical Mode Decomposition and RBFNN , 2013 .

[4]  Robert P. Broadwater,et al.  Current status and future advances for wind speed and power forecasting , 2014 .

[5]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  Alexander Gammerman,et al.  Ridge Regression Learning Algorithm in Dual Variables , 1998, ICML.

[7]  Mandava Rajeswari,et al.  The variants of the harmony search algorithm: an overview , 2011, Artificial Intelligence Review.

[8]  Cunbin Li,et al.  A least squares support vector machine model optimized by moth-flame optimization algorithm for annual power load forecasting , 2016, Applied Intelligence.

[9]  J. Torres,et al.  Forecast of hourly average wind speed with ARMA models in Navarre (Spain) , 2005 .

[10]  Bijay Ketan Panigrahi,et al.  Ant lion optimization for short-term wind integrated hydrothermal power generation scheduling , 2016 .

[11]  Jianzhou Wang,et al.  A hybrid forecasting approach applied to wind speed time series , 2013 .

[12]  Huei-Lin Chang,et al.  Hour-ahead wind power and speed forecasting using simultaneous perturbation stochastic approximation (SPSA) algorithm and neural network with fuzzy inputs , 2010 .

[13]  Yew-Soon Ong,et al.  A Fast Reduced Kernel Extreme Learning Machine , 2016, Neural Networks.

[14]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[15]  W. Rivera,et al.  Wind speed forecasting in the South Coast of Oaxaca, México , 2007 .

[16]  Leonardo Ramos Rodrigues,et al.  Building selective ensembles of Randomization Based Neural Networks with the successive projections algorithm , 2017, Appl. Soft Comput..

[17]  Xiaobing Kong,et al.  Wind speed prediction using reduced support vector machines with feature selection , 2015, Neurocomputing.

[18]  Janez Brest,et al.  A comprehensive review of firefly algorithms , 2013, Swarm Evol. Comput..

[19]  Le Zhang,et al.  Visual Tracking With Convolutional Random Vector Functional Link Network , 2017, IEEE Transactions on Cybernetics.

[20]  Mahamed G. H. Omran,et al.  Global-best harmony search , 2008, Appl. Math. Comput..

[21]  Ling Tang,et al.  A non-iterative decomposition-ensemble learning paradigm using RVFL network for crude oil price forecasting , 2017, Appl. Soft Comput..

[22]  Ponnuthurai N. Suganthan,et al.  Random vector functional link network for short-term electricity load demand forecasting , 2016, Inf. Sci..

[23]  P. N. Suganthan,et al.  An Ensemble of Kernel Ridge Regression for Multi-class Classification , 2017, ICCS.

[24]  Hubert A.B. Te Braake,et al.  Random activation weight neural net (RAWN) for fast non-iterative training. , 1995 .

[25]  Qinghua Hu,et al.  Kernel ridge regression for general noise model with its application , 2015, Neurocomputing.

[26]  G. Camps-Valls,et al.  Adaptive kernel ridge regression for image denoising , 2010, 2010 IEEE International Workshop on Machine Learning for Signal Processing.

[27]  Osamah Basheer Shukur,et al.  Daily wind speed forecasting through hybrid KF-ANN model based on ARIMA , 2015 .

[28]  Dejan J. Sobajic,et al.  Learning and generalization characteristics of the random vector Functional-link net , 1994, Neurocomputing.

[29]  Huiru Zhao,et al.  Annual Electric Load Forecasting by a Least Squares Support Vector Machine with a Fruit Fly Optimization Algorithm , 2012 .

[30]  Abdul Hanan Abdullah,et al.  LAHS: A novel harmony search algorithm based on learning automata , 2013, Commun. Nonlinear Sci. Numer. Simul..

[31]  Ponnuthurai N. Suganthan,et al.  A Novel Empirical Mode Decomposition With Support Vector Regression for Wind Speed Forecasting , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[32]  Sen Guo,et al.  A hybrid annual power load forecasting model based on generalized regression neural network with fruit fly optimization algorithm , 2013, Knowl. Based Syst..

[33]  R. Law.  Back-propagation learning in improving the accuracy of neural network-based tourism demand forecasting , 2000 .

[34]  Heping Liu,et al.  Prediction of wind speed time series using modified Taylor Kriging method , 2010 .

[35]  A. B. Dariane,et al.  Performance evaluation of an improved harmony search algorithm for numerical optimization: Melody Search (MS) , 2013, Eng. Appl. Artif. Intell..

[36]  P. K. Dash,et al.  A firefly optimized fast extreme learning machine based maximum power point tracking for stability analysis of microgrid with two stage photovoltaic generation system , 2016 .

[37]  Svetha Venkatesh,et al.  Face Recognition Using Kernel Ridge Regression , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Dejan J. Sobajic,et al.  Artificial Neural-Net Based Dynamic Security Assessment for Electric Power Systems , 1989, IEEE Power Engineering Review.

[39]  Sun-Yuan Kung,et al.  Cost-effective kernel ridge regression implementation for keystroke-based active authentication system , 2017, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[40]  P. N. Suganthan,et al.  A comprehensive evaluation of random vector functional link networks , 2016, Inf. Sci..

[41]  Yoh-Han Pao,et al.  Stochastic choice of basis functions in adaptive function approximation and the functional-link net , 1995, IEEE Trans. Neural Networks.

[42]  C. L. Philip Chen,et al.  A rapid supervised learning neural network for function interpolation and approximation , 1996, IEEE Trans. Neural Networks.

[43]  Gavin C. Cawley,et al.  Reduced Rank Kernel Ridge Regression , 2002, Neural Processing Letters.

[44]  Robert P. W. Duin,et al.  Feedforward neural networks with random weights , 1992, Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol.II. Conference B: Pattern Recognition Methodology and Systems.

[45]  Chao Chen,et al.  A hybrid model for wind speed prediction using empirical mode decomposition and artificial neural networks , 2012 .

[46]  Jin Lin,et al.  An hour ahead wind speed prediction by Kalman filter , 2012, 2012 IEEE Power Electronics and Machines in Wind Applications.

[47]  Jing Shi,et al.  On comparing three artificial neural networks for wind speed forecasting , 2010 .

[48]  Joao P. S. Catalao,et al.  Application of adaptive neuro‐fuzzy inference for wind power short‐term forecasting , 2011 .

[49]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[50]  Peter Lynch,et al.  The origins of computer weather prediction and climate modeling , 2008, J. Comput. Phys..

[51]  Haiyan Jiang,et al.  An Experimental Investigation of FNN Model for Wind Speed Forecasting Using EEMD and CS , 2015 .

[52]  P. N. Suganthan,et al.  A Comparative Study of Empirical Mode Decomposition-Based Short-Term Wind Speed Forecasting Methods , 2015, IEEE Transactions on Sustainable Energy.

[53]  Hui Liu,et al.  Forecasting models for wind speed using wavelet, wavelet packet, time series and Artificial Neural Networks , 2013 .

[54]  M. A. Behrang,et al.  An Analysis of Wind Speed Prediction Using Artificial Neural Networks: A Case Study in Manjil, Iran , 2012 .

[55]  Haiyan Lu,et al.  Multi-step forecasting for wind speed using a modified EMD-based artificial neural network model , 2012 .

[56]  P. Dokopoulos,et al.  Short-term forecasting of wind speed and related electrical power , 1998 .

[57]  M. Lange,et al.  Physical Approach to Short-Term Wind Power Prediction , 2005 .