Ensemble Recurrent Neural Network Based Probabilistic Wind Speed Forecasting Approach

Wind energy is a commonly utilized renewable energy source, due to its merits of extensive distribution and rich reserves. However, as wind speed fluctuates violently and uncertainly at all times, wind power integration may affect the security and stability of power system. In this study, we propose an ensemble model for probabilistic wind speed forecasting. It consists of wavelet threshold denoising (WTD), recurrent neural network (RNN) and adaptive neuro fuzzy inference system (ANFIS). Firstly, WTD smooths the wind speed series in order to better capture its variation trend. Secondly, RNNs with different architectures are trained on the denoising datasets, operating as sub-models for point wind speed forecasting. Thirdly, ANFIS is innovatively established as the top layer of the entire ensemble model to compute the final point prediction result, in order to take full advantages of a limited number of deep-learning-based sub-models. Lastly, variances are obtained from sub-models and then prediction intervals of probabilistic forecasting can be calculated, where the variances inventively consist of modeling and forecasting uncertainties. The proposed ensemble model is established and verified on less than one-hour-ahead ultra-short-term wind speed forecasting. We compare it with other soft computing models. The results indicate the feasibility and superiority of the proposed model in both point and probabilistic wind speed forecasting.

[1]  R. Kavasseri,et al.  Day-ahead wind speed forecasting using f-ARIMA models , 2009 .

[2]  Mugen Peng,et al.  A Data Mining Approach Combining $K$ -Means Clustering With Bagging Neural Network for Short-Term Wind Power Forecasting , 2017, IEEE Internet of Things Journal.

[3]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[4]  Asifullah Khan,et al.  Wind power prediction using deep neural network based meta regression and transfer learning , 2017, Appl. Soft Comput..

[5]  J. Adamowski,et al.  A wavelet neural network conjunction model for groundwater level forecasting , 2011 .

[6]  Alex Graves,et al.  Supervised Sequence Labelling with Recurrent Neural Networks , 2012, Studies in Computational Intelligence.

[7]  Sonia Leva,et al.  Physical and hybrid methods comparison for the day ahead PV output power forecast , 2017 .

[8]  S. Pryor,et al.  Wind speed trends over China: quantifying the magnitude and assessing causality , 2013 .

[9]  Jianzhou Wang,et al.  Estimation methods review and analysis of offshore extreme wind speeds and wind energy resources , 2015 .

[10]  Okyay Kaynak,et al.  Rough Deep Neural Architecture for Short-Term Wind Speed Forecasting , 2017, IEEE Transactions on Industrial Informatics.

[11]  Jinzhong Min,et al.  Observed surface wind speed in the Tibetan Plateau since 1980 and its physical causes , 2014 .

[12]  Sungwon Kim,et al.  Estimation of Long-Term Monthly Temperatures by Three Different Adaptive Neuro-Fuzzy Approaches Using Geographical Inputs , 2017 .

[13]  Sepp Hochreiter,et al.  The Vanishing Gradient Problem During Learning Recurrent Neural Nets and Problem Solutions , 1998, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[14]  Alessandro Niccolai,et al.  Computational Intelligence Techniques Applied to the Day Ahead PV Output Power Forecast: PHANN, SNO and Mixed , 2018, Energies.

[15]  Chu Zhang,et al.  Multi-step ahead wind speed forecasting using a hybrid model based on two-stage decomposition technique and AdaBoost-extreme learning machine , 2017 .

[16]  Jian Su,et al.  A novel bidirectional mechanism based on time series model for wind power forecasting , 2016 .

[17]  Jianzhou Wang,et al.  Analysis and application of forecasting models in wind power integration: A review of multi-step-ahead wind speed forecasting models , 2016 .

[18]  İnci Okumuş,et al.  Current status of wind energy forecasting and a hybrid method for hourly predictions , 2016 .

[19]  Diogo E. Aguiam,et al.  Estimation of X-Mode Reflectometry First Fringe Frequency Using Neural Networks , 2018, IEEE Transactions on Plasma Science.

[20]  Yitao Liu,et al.  Deep learning based ensemble approach for probabilistic wind power forecasting , 2017 .

[21]  Marios Savvides,et al.  Reformulating Level Sets as Deep Recurrent Neural Network Approach to Semantic Segmentation , 2017, IEEE Transactions on Image Processing.

[22]  Martin Wattenberg,et al.  Visualizing Dataflow Graphs of Deep Learning Models in TensorFlow , 2018, IEEE Transactions on Visualization and Computer Graphics.

[23]  Haiyan Li,et al.  Probability density forecasting of wind power using quantile regression neural network and kernel density estimation , 2018 .

[24]  Jing Zhao,et al.  Hybrid Wind Speed Prediction Based on a Self-Adaptive ARIMAX Model with an Exogenous WRF Simulation , 2015 .

[25]  Mehrdad Saif,et al.  Application of imputation techniques and Adaptive Neuro-Fuzzy Inference System to predict wind turbine power production , 2017 .

[26]  Francesco Grimaccia,et al.  Analysis and validation of 24 hours ahead neural network forecasting of photovoltaic output power , 2017, Math. Comput. Simul..

[27]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[28]  Ergin Erdem,et al.  ARMA based approaches for forecasting the tuple of wind speed and direction , 2011 .

[29]  Hui Liu,et al.  Comparison of new hybrid FEEMD-MLP, FEEMD-ANFIS, Wavelet Packet-MLP and Wavelet Packet-ANFIS for wind speed predictions , 2015 .

[30]  Ponnuthurai Nagaratnam Suganthan,et al.  Ensemble methods for wind and solar power forecasting—A state-of-the-art review , 2015 .

[31]  D. Jager,et al.  NREL National Wind Technology Center (NWTC): M2 Tower; Boulder, Colorado (Data) , 1996 .

[32]  Guowei Cai,et al.  Hybrid Short Term Wind Speed Forecasting Using Variational Mode Decomposition and a Weighted Regularized Extreme Learning Machine , 2016 .

[33]  Akin Tascikaraoglu,et al.  A review of combined approaches for prediction of short-term wind speed and power , 2014 .

[34]  Jianzhou Wang,et al.  Short-term wind speed prediction using empirical wavelet transform and Gaussian process regression , 2015 .

[35]  Miao He,et al.  Support-Vector-Machine-Enhanced Markov Model for Short-Term Wind Power Forecast , 2015, IEEE Transactions on Sustainable Energy.

[36]  Thomas Reindl,et al.  Short term solar irradiance forecasting using a mixed wavelet neural network , 2016 .

[37]  Duehee Lee,et al.  Short-Term Wind Power Ensemble Prediction Based on Gaussian Processes and Neural Networks , 2014, IEEE Transactions on Smart Grid.

[38]  Julien Eynard,et al.  Wavelet-based multi-resolution analysis and artificial neural networks for forecasting temperature and thermal power consumption , 2011, Eng. Appl. Artif. Intell..

[39]  Yanfei Li,et al.  Wind speed forecasting method based on deep learning strategy using empirical wavelet transform, long short term memory neural network and Elman neural network , 2018 .

[40]  Duehee Lee,et al.  Spatial and Temporal Day-Ahead Total Daily Solar Irradiation Forecasting: Ensemble Forecasting Based on the Empirical Biasing , 2017 .

[41]  Kit Po Wong,et al.  Probabilistic Forecasting of Wind Power Generation Using Extreme Learning Machine , 2014, IEEE Transactions on Power Systems.

[42]  Dongsheng Guo,et al.  Novel Recurrent Neural Network for Time-Varying Problems Solving [Research Frontier] , 2012, IEEE Computational Intelligence Magazine.

[43]  Osamah Basheer Shukur,et al.  Daily wind speed forecasting through hybrid KF-ANN model based on ARIMA , 2015 .

[44]  Fei Shen,et al.  Machine Health Monitoring Using Local Feature-Based Gated Recurrent Unit Networks , 2018, IEEE Transactions on Industrial Electronics.

[45]  Yitao Liu,et al.  Deep belief network based deterministic and probabilistic wind speed forecasting approach , 2016 .

[46]  Stefan Lessmann,et al.  A comparative study of LSTM neural networks in forecasting day-ahead global horizontal irradiance with satellite data , 2018 .

[47]  Bikash Kumar Sahu.  Wind energy developments and policies in China: A short review , 2018 .

[48]  Hermann Ney,et al.  From Feedforward to Recurrent LSTM Neural Networks for Language Modeling , 2015, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[49]  H. J. Lu,et al.  An improved neural network-based approach for short-term wind speed and power forecast , 2017 .

[50]  Yanfei Li,et al.  Smart multi-step deep learning model for wind speed forecasting based on variational mode decomposition, singular spectrum analysis, LSTM network and ELM , 2018 .

[51]  Shuo Wang,et al.  Short-term power load probability density forecasting method using kernel-based support vector quantile regression and Copula theory , 2017 .

[52]  Robert P. Broadwater,et al.  Current status and future advances for wind speed and power forecasting , 2014 .

[53]  Dalibor Petković,et al.  Potential of adaptive neuro-fuzzy system for prediction of daily global solar radiation by day of the year , 2015 .

[54]  Ladislav Zjavka,et al.  Wind speed forecast correction models using polynomial neural networks , 2015 .

[55]  Stefano Panzieri,et al.  Urban traffic flow forecasting through statistical and neural network bagging ensemble hybrid modeling , 2015, Neurocomputing.

[56]  Duehee Lee,et al.  Very Short-Term Wind Power Ensemble Forecasting without Numerical Weather Prediction through the Predictor Design , 2017 .

[57]  Maria Grazia De Giorgi,et al.  Comparison Between Wind Power Prediction Models Based on Wavelet Decomposition with Least-Squares Support Vector Machine (LS-SVM) and Artificial Neural Network (ANN) , 2014 .

[58]  Ali Emadi,et al.  Long Short-Term Memory Networks for Accurate State-of-Charge Estimation of Li-ion Batteries , 2018, IEEE Transactions on Industrial Electronics.

[59]  Qunli Wu,et al.  Wind Power Generation Forecasting Using Least Squares Support Vector Machine Combined with Ensemble Empirical Mode Decomposition, Principal Component Analysis and a Bat Algorithm , 2016 .

[60]  Ashraf A. Kassim,et al.  Signal and Image Approximation Using Interval Wavelet Transform , 2007, IEEE Transactions on Image Processing.