Wind speed and wind direction forecasting using echo state network with nonlinear functions

Wind turbines are among the most popular sources of renewable energy. The energy available from wind varies widely because wind energy is highly dependent on continually fluctuating weather related parameters such as wind speed and wind direction. Wind farms have difficulties with system scheduling and energy dispatching because the availability of wind power is not known in advance. Therefore, the growth of wind power penetration in the emerging power system has made a precise wind forecasting method indispensable for system operators to include wind power generation in unit commitment and economic scheduling. This paper proposes two methods for wind speed and direction forecasting based on the nonlinear relations between the internal states of echo state networks. The methods decrease the number of internal states, and reduce the computational load compared to classical ESNs with fixed sizes and topologies by reducing the orders of the weight matrices. The design is simple with high learning capability and prediction accuracy, and does not require extensive training, parameter tuning, or complex optimization. The methods are tested with wind speed and direction data provided by the Nevada department of transportation (NDOT) roadway weather stations in the Reno, NV area. To demonstrate the efficiency of the proposed methods, they are compared with classical echo state networks (ESN) and with adaptive neuro-fuzzy inference system (ANFIS). The results of the new methods compare favorably with both ESN and ANFIS.

[1]  Tao Li,et al.  Review of Evaluation Criteria and Main Methods of Wind Power Forecasting , 2011 .

[2]  Saida Makhloufi,et al.  Wind speed and wind power forecasting using wavelet denoising-GMDH neural network , 2017, 2017 5th International Conference on Electrical Engineering - Boumerdes (ICEE-B).

[3]  Simon Haykin,et al.  Decoupled echo state networks with lateral inhibition , 2007, Neural Networks.

[4]  T. Chai,et al.  Root mean square error (RMSE) or mean absolute error (MAE)? – Arguments against avoiding RMSE in the literature , 2014 .

[5]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.

[6]  Kwang-Ho Kim,et al.  Implementation of hybrid short-term load forecasting system using artificial neural networks and fuzzy expert systems , 1995 .

[7]  Hsiao-Dong Chiang,et al.  A High-Accuracy Wind Power Forecasting Model , 2017, IEEE Transactions on Power Systems.

[8]  Yang Fu,et al.  Short-term wind power forecasts by a synthetical similar time series data mining method , 2018 .

[9]  V M F Mendes,et al.  Hybrid Wavelet-PSO-ANFIS Approach for Short-Term Wind Power Forecasting in Portugal , 2011, IEEE Transactions on Sustainable Energy.

[10]  C. Willmott,et al.  Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance , 2005 .

[11]  Meysam Qadrdan,et al.  Probabilistic wind power forecasting and its application in the scheduling of gas-fired generators , 2017 .

[12]  Ricardo J. Bessa,et al.  Improving Renewable Energy Forecasting With a Grid of Numerical Weather Predictions , 2017, IEEE Transactions on Sustainable Energy.

[13]  Junfei Qiao,et al.  Growing Echo-State Network With Multiple Subreservoirs , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[14]  Pierre Pinson,et al.  Foreword for the Special Section on Wind and Solar Energy: Uncovering and Accommodating Their Impacts on Electricity Markets , 2015 .

[15]  Peter Tiño,et al.  Minimum Complexity Echo State Network , 2011, IEEE Transactions on Neural Networks.

[16]  Wei Sun,et al.  Wind speed forecasting using FEEMD echo state networks with RELM in Hebei, China , 2016 .

[17]  Jie Zhang,et al.  Wind Power Ramp Event Forecasting Using a Stochastic Scenario Generation Method , 2015, IEEE Transactions on Sustainable Energy.

[18]  Furong Li,et al.  Novel Cost Model for Balancing Wind Power Forecasting Uncertainty , 2017, IEEE Transactions on Energy Conversion.

[19]  Tomonobu Senjyu,et al.  Next Day Peak Load Forecasting Using Neural Network With Adaptive Learning Algorithm Based On Similarity , 2000 .

[20]  Gwo-Ching Liao,et al.  Application of a fuzzy neural network combined with a chaos genetic algorithm and simulated annealing to short-term load forecasting , 2006, IEEE Transactions on Evolutionary Computation.

[21]  Mario Vasak,et al.  Optimal wind turbine yaw control supported with very short-term wind predictions , 2015, 2015 IEEE International Conference on Industrial Technology (ICIT).

[22]  Zhou Quan,et al.  RBF Neural Network and ANFIS-Based Short-Term Load Forecasting Approach in Real-Time Price Environment , 2008, IEEE Transactions on Power Systems.

[23]  Kit Po Wong,et al.  Probabilistic Forecasting of Wind Power Generation Using Extreme Learning Machine , 2014, IEEE Transactions on Power Systems.

[24]  D. Infield,et al.  Application of Auto-Regressive Models to U.K. Wind Speed Data for Power System Impact Studies , 2012, IEEE Transactions on Sustainable Energy.

[25]  William D'haeseleer,et al.  Optimization and allocation of spinning reserves in a low-carbon framework , 2016, 2016 IEEE Power and Energy Society General Meeting (PESGM).

[26]  Qingli Dong,et al.  A novel forecasting model based on a hybrid processing strategy and an optimized local linear fuzzy neural network to make wind power forecasting: A case study of wind farms in China , 2017 .

[27]  G. Sideratos,et al.  Using Radial Basis Neural Networks to Estimate Wind Power Production , 2007, 2007 IEEE Power Engineering Society General Meeting.

[28]  Edgar N. Sánchez,et al.  Higher Order Wavelet Neural Networks with Kalman learning for wind speed forecasting , 2011, 2011 IEEE Symposium on Computational Intelligence Applications In Smart Grid (CIASG).

[29]  Pericles A. Mitkas,et al.  Adaptive reservoir computing through evolution and learning , 2013, Neurocomputing.

[30]  Ioannis B. Theocharis,et al.  Locally recurrent neural networks for long-term wind speed and power prediction , 2006, Neurocomputing.

[31]  Weifeng Liu,et al.  Extended Kernel Recursive Least Squares Algorithm , 2009, IEEE Transactions on Signal Processing.

[32]  Andrzej M. Trzynadlowski,et al.  Wind speed forecasting using an echo state network with nonlinear output functions , 2017, 2017 American Control Conference (ACC).

[33]  Akin Tascikaraoglu,et al.  A review of combined approaches for prediction of short-term wind speed and power , 2014 .

[34]  Kameshwar Poolla,et al.  Exploiting sparsity of interconnections in spatio-temporal wind speed forecasting using Wavelet Transform , 2016 .

[35]  Herbert Jaeger,et al.  Optimization and applications of echo state networks with leaky- integrator neurons , 2007, Neural Networks.

[36]  Henrik Madsen,et al.  A review on the young history of the wind power short-term prediction , 2008 .

[37]  Jin Lin,et al.  Direct Quantile Regression for Nonparametric Probabilistic Forecasting of Wind Power Generation , 2017, IEEE Transactions on Power Systems.

[38]  Herbert Jaeger,et al.  Adaptive Nonlinear System Identification with Echo State Networks , 2002, NIPS.

[39]  Adel Nasiri,et al.  A multi‐predictor model to estimate solar and wind energy generations , 2018 .

[40]  Farshid Keynia,et al.  A new hybrid iterative method for short‐term wind speed forecasting , 2011 .

[41]  Xiaoru Wang,et al.  A novel hybrid methodology for short-term wind power forecasting based on adaptive neuro-fuzzy inference system , 2017 .

[42]  Li-Chih Ying,et al.  Using adaptive network based fuzzy inference system to forecast regional electricity loads , 2008 .

[43]  Hamidreza Zareipour,et al.  Wind power forecast using wavelet neural network trained by improved Clonal selection algorithm , 2015 .

[44]  Vera Chung,et al.  Forecasting wind power in the Mai Liao Wind Farm based on the multi-layer perceptron artificial neural network model with improved simplified swarm optimization , 2014 .

[45]  M. Negnevitsky,et al.  Very short-term wind forecasting for Tasmanian power generation , 2006, 2006 IEEE Power Engineering Society General Meeting.

[46]  Joao P. S. Catalao,et al.  A hybrid PSO–ANFIS approach for short-term wind power prediction in Portugal , 2011 .

[47]  Saeid Nahavandi,et al.  A New Fuzzy-Based Combined Prediction Interval for Wind Power Forecasting , 2016, IEEE Transactions on Power Systems.

[48]  Grzegorz Dudek.  Pattern-based local linear regression models for short-term load forecasting , 2016 .

[49]  José Carlos Príncipe,et al.  Analysis and Design of Echo State Networks , 2007, Neural Computation.

[50]  Gerard Ledwich,et al.  Fast Unscented Transformation-Based Transient Stability Margin Estimation Incorporating Uncertainty of Wind Generation , 2015, IEEE Transactions on Sustainable Energy.

[51]  Fushuan Wen,et al.  Flexible Operational Planning Framework Considering Multiple Wind Energy Forecasting Service Providers , 2016, IEEE Transactions on Sustainable Energy.

[52]  H Zareipour,et al.  Wind Power Prediction by a New Forecast Engine Composed of Modified Hybrid Neural Network and Enhanced Particle Swarm Optimization , 2011, IEEE Transactions on Sustainable Energy.

[53]  Paras Mandal,et al.  A review of wind power and wind speed forecasting methods with different time horizons , 2010, North American Power Symposium 2010.

[54]  Mantas Lukosevicius,et al.  Reservoir Computing and Self-Organized Neural Hierarchies , 2012 .

[55]  Wei-Jen Lee,et al.  Short-Term Load Forecasting Using Comprehensive Combination Based on Multimeteorological Information , 2009, IEEE Transactions on Industry Applications.

[56]  Stefan J. Kiebel,et al.  Re-visiting the echo state property , 2012, Neural Networks.

[57]  C. N. Lu,et al.  A Data Mining Approach for Spatial Modeling in Small Area Load Forecast , 2002, IEEE Power Engineering Review.

[58]  Roger Labahn,et al.  Design Strategies for Weight Matrices of Echo State Networks , 2012, Neural Computation.

[59]  Zhidong Deng,et al.  Collective Behavior of a Small-World Recurrent Neural System With Scale-Free Distribution , 2007, IEEE Transactions on Neural Networks.

[60]  Ponnuthurai N. Suganthan,et al.  A Novel Empirical Mode Decomposition With Support Vector Regression for Wind Speed Forecasting , 2016, IEEE Transactions on Neural Networks and Learning Systems.