Particle-swarm optimization of ensemble neural networks with negative correlation learning for forecasting short-term wind speed of wind farms in western China

Abstract In many countries, wind power is being developed as a primary source of renewable energy. However, it is difficult to describe and forecast wind speed features, which are stochastic and intermittently complex. Moreover, it is important both to obtain precise forecasts of wind speed for wind power generation and to determine their contribution to regional economies. In this paper, we propose a novel approach for wind speed forecasting. The proposed model is a hybrid that uses the wavelet analysis technique (WAT) for denoising, a negative correlation learning neural network (NCL-NN) ensemble, and an ensemble structure optimized using particle-swarm optimization (PSO). We name the approach WAT-NCL-PSO. We define a novel fitness function to optimize the performance of the NCL-NN ensemble. Then, we rebuild the new NCL-NN ensemble using the contribution rates (CRs) by applying the PSO algorithm. We compiled wind speed datasets from six wind power generator sites in western China and used them to test the performance of the proposed model. Further, we analyzed the model’s performance in terms of its robustness and time complexity. Finally, to illustrate the effectiveness of the proposed approach, we compared its performance with that of the back-propagation neural network (BPNN), support vector machine (SVM), bagging, AdaBoost, random forest (RF), long short-term memory (LSTM), seasonal autoregressive integrated moving average (SARIMA), SVM with ensemble empirical mode decomposition (EEMD-SVM), and NCL-NN with wavelet denoising (WAT-NCL) models. The simulation results demonstrate that the performance of the WAT-NCL-PSO model is superior to other methods in terms of forecasting accuracy for short-term wind speeds.

[1]  Shenghuo Zhu,et al.  A survey on wavelet applications in data mining , 2002, SKDD.

[2]  Reza Ebrahimpour,et al.  Combining features of negative correlation learning with mixture of experts in proposed ensemble methods , 2012, Appl. Soft Comput..

[3]  Tingting Guo,et al.  Short-Term Load Forecasting for Electric Power Systems Using the PSO-SVR and FCM Clustering Techniques , 2011 .

[4]  Tao Zhang,et al.  A Method on Obtaining Best Wavelet Packet Decomposition Level and Reducing Noise of Hyperspectral Image , 2013 .

[5]  Antonino Musolino,et al.  A Wavelet Based Method for the Analysis of Impulsive Noise Due to Switch Commutations in Power Line Communication (PLC) Systems , 2011, IEEE Transactions on Smart Grid.

[6]  Jianzhou Wang,et al.  Performance analysis of four modified approaches for wind speed forecasting , 2012 .

[7]  Wenyu Zhang,et al.  Short-term wind speed forecasting based on a hybrid model , 2013, Appl. Soft Comput..

[8]  Sanda Martinčić-Ipšić,et al.  Link prediction on Twitter , 2017, PloS one.

[9]  Diego R. Amancio,et al.  Comparing the topological properties of real and artificially generated scientific manuscripts , 2015, Scientometrics.

[10]  Sheng-Tun Li,et al.  Knowledge discovery in financial investment for forecasting and trading strategy through wavelet-based SOM networks , 2008, Expert Syst. Appl..

[11]  Shuai Zhang,et al.  Hybrid self-optimized clustering model based on citation links and textual features to detect research topics , 2017, PloS one.

[12]  Dong Xu,et al.  NOISE ESTIMATION OF HYPERSPECTRAL REMOTE SENSING IMAGE BASED ON MULTIPLE LINEAR REGRESSION AND WAVELET TRANSFORM , 2013 .

[13]  Peter York,et al.  Optimisation of the predictive ability of artificial neural network (ANN) models: a comparison of three ANN programs and four classes of training algorithm. , 2005, European journal of pharmaceutical sciences : official journal of the European Federation for Pharmaceutical Sciences.

[14]  Stefano Alessandrini,et al.  A comparison between the ECMWF and COSMO Ensemble Prediction Systems applied to short-term wind power forecasting on real data , 2013 .

[15]  T. Jayakumar,et al.  Continuous Wavelet Transform Analysis for the Enhancement of Signal-to-noise Ratio in Coarse Grain Austenitic Stainless Steel , 2014 .

[16]  Huanhuan Chen,et al.  Multiobjective Neural Network Ensembles Based on Regularized Negative Correlation Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[17]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[18]  Andrea E. Olsson Particle Swarm Optimization: Theory, Techniques and Applications , 2010 .

[19]  Zijun Zhang,et al.  Short-term wind speed forecasting with Markov-switching model , 2014 .

[20]  Dongxiao Niu,et al.  Short-term wind speed forecasting using wavelet transform and support vector machines optimized by genetic algorithm , 2014 .

[21]  Diego R. Amancio,et al.  Word sense disambiguation via high order of learning in complex networks , 2012, ArXiv.

[22]  Martha Pulido,et al.  Particle swarm optimization of ensemble neural networks with fuzzy aggregation for time series prediction of the Mexican Stock Exchange , 2014, Inf. Sci..

[23]  Azuraliza Abu Bakar,et al.  Multi-objective PSO algorithm for mining numerical association rules without a priori discretization , 2014, Expert Syst. Appl..

[24]  Marco Mussetta,et al.  Adaptive Wavelet Neural Network Based Wind Speed Forecasting Studies , 2014 .

[25]  A. Selakov,et al.  Hybrid PSO-SVM method for short-term load forecasting during periods with significant temperature variations in city of Burbank , 2014, Appl. Soft Comput..

[26]  Zhang Yan,et al.  A review on the forecasting of wind speed and generated power , 2009 .

[27]  James Kennedy,et al.  Defining a Standard for Particle Swarm Optimization , 2007, 2007 IEEE Swarm Intelligence Symposium.

[28]  Jujie Wang,et al.  A Hybrid Wavelet Transform Based Short-Term Wind Speed Forecasting Approach , 2014, TheScientificWorldJournal.

[29]  Shouyang Wang,et al.  Ensemble ANNs-PSO-GA Approach for Day-ahead Stock E-exchange Prices Forecasting , 2014, Int. J. Comput. Intell. Syst..

[30]  Chen Hua-you Research on Superior Combination Forecasting Model Based on Forecasting Effective Measure , 2002 .

[31]  Meng Liu,et al.  An EVT-based worst-case Response Time Analysis of complex real-time systems , 2013, 2013 8th IEEE International Symposium on Industrial Embedded Systems (SIES).

[32]  Ajit Achuthan,et al.  Recursive wind speed forecasting based on Hammerstein Auto-Regressive model , 2015 .

[33]  Osamah Basheer Shukur,et al.  Daily wind speed forecasting through hybrid KF-ANN model based on ARIMA , 2015 .

[34]  Aleksandar Erdeljan,et al.  Distributed PSO Algorithm for Data Model Partitioning in Power Distribution Systems , 2014 .

[35]  Maria Bardosova,et al.  Using network science and text analytics to produce surveys in a scientific topic , 2015, J. Informetrics.

[36]  Pedro Antonio Gutiérrez,et al.  Negative Correlation Ensemble Learning for Ordinal Regression , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[37]  Huanhuan Chen,et al.  Regularized Negative Correlation Learning for Neural Network Ensembles , 2009, IEEE Transactions on Neural Networks.

[38]  Qunzhan Li,et al.  Short-term wind speed syntheses correcting forecasting model and its application , 2013 .

[39]  X. Wang,et al.  Wind speed forecasting for power system operational planning , 2005, 2004 International Conference on Probabilistic Methods Applied to Power Systems.

[40]  Chuanan Yao,et al.  Wind Speed Forecasting by Wavelet Neural Networks: A Comparative Study , 2013 .

[41]  Xin Yao,et al.  Selective negative correlation learning approach to incremental learning , 2009, Neurocomputing.

[42]  Sivanagaraja Tatinati,et al.  A Hybrid Approach for Short-Term Forecasting of Wind Speed , 2013, TheScientificWorldJournal.

[43]  Eamonn J. Keogh,et al.  Exact indexing of dynamic time warping , 2002, Knowledge and Information Systems.

[44]  Wang Jilong,et al.  Short-term wind speed forecasting based on spectral clustering and optimised echo state networks , 2015 .

[45]  David L. Donoho,et al.  De-noising by soft-thresholding , 1995, IEEE Trans. Inf. Theory.

[46]  Wei Tang,et al.  Ensembling neural networks: Many could be better than all , 2002, Artif. Intell..

[47]  Reza Ebrahimpour,et al.  Improving combination method of NCL experts using gating network , 2011, Neural Computing and Applications.

[48]  Diego R. Amancio,et al.  A Complex Network Approach to Stylometry , 2015, PloS one.