A Multi-Scale Model based on the Long Short-Term Memory for day ahead hourly wind speed forecasting

Abstract Crucial to wind energy penetration in electrical systems is the precise forecasting of wind speed, which turns into accurate future wind power estimates. Current trends in wind speed forecasting involve using Recurrent Neural Networks to model complex temporal dynamics in the time-series. These networks, however, have problems learning long temporal dependencies in the data. To address this issue, we devise a Multi-scale Model Based on the Long Short-Term Memory for the day-ahead hourly wind speed forecasting task. Our model uses dense layers to build sub-sequences of different timescales which are used as input for multiple Long Short-Term Memory Networks (LSTM), which model each temporal scale and integrate their information accordingly. An experiment with altered wind speed data shows that our proposal is better able to learn long term dependencies than the stacked LSTM. Furthermore, results on four wind speed datasets of varying length from northern Chile reveal that our approach outperforms several models in terms of MAE and RMSE. Training times also exhibit that adding depth to the model does not increase computational times substantially, making it a more efficient approach than the stacked LSTM.

[1]  Barbara Hammer,et al.  On the approximation capability of recurrent neural networks , 2000, Neurocomputing.

[2]  Hui Liu,et al.  Smart deep learning based wind speed prediction model using wavelet packet decomposition, convolutional neural network and convolutional long short term memory network , 2018 .

[3]  A. Immanuel Selvakumar,et al.  A comprehensive review on wind turbine power curve modeling techniques , 2014 .

[4]  José Manuel Benítez,et al.  On the use of cross-validation for time series predictor evaluation , 2012, Inf. Sci..

[5]  Yanfei Li,et al.  Wind speed forecasting method based on deep learning strategy using empirical wavelet transform, long short term memory neural network and Elman neural network , 2018 .

[6]  Yuqing Chang,et al.  Gated Recurrent Unit Network-Based Short-Term Photovoltaic Forecasting , 2018, Energies.

[7]  Chaker El Amrani,et al.  Sequence to Sequence Weather Forecasting with Long Short-Term Memory Recurrent Neural Networks , 2016 .

[8]  Razvan Pascanu,et al.  On the difficulty of training recurrent neural networks , 2012, ICML.

[9]  Jakob Grue Simonsen,et al.  A Hierarchical Recurrent Encoder-Decoder for Generative Context-Aware Query Suggestion , 2015, CIKM.

[10]  Li Fei,et al.  Multi-step wind speed prediction based on turbulence intensity and hybrid deep neural networks , 2019, Energy Conversion and Management.

[11]  Amir F. Atiya,et al.  A review and comparison of strategies for multi-step ahead time series forecasting based on the NN5 forecasting competition , 2011, Expert Syst. Appl..

[12]  Yoshua Bengio,et al.  Hierarchical Recurrent Neural Networks for Long-Term Dependencies , 1995, NIPS.

[13]  Héctor Allende,et al.  LSTM-Based Multi-scale Model for Wind Speed Forecasting , 2018, CIARP.

[14]  Yanfei Li,et al.  Smart multi-step deep learning model for wind speed forecasting based on variational mode decomposition, singular spectrum analysis, LSTM network and ELM , 2018 .

[15]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[16]  Haojun Tang,et al.  A novel framework for wind speed prediction based on recurrent neural networks and support vector machine , 2018, Energy Conversion and Management.