“Dust in the Wind...”, Deep Learning Application to Wind Energy Time Series Forecasting

To balance electricity production and demand, it is required to use different prediction techniques extensively. Renewable energy, due to its intermittency, increases the complexity and uncertainty of forecasting, and the resulting accuracy impacts all the different players acting around the electricity systems around the world like generators, distributors, retailers, or consumers. Wind forecasting can be done under two major approaches, using meteorological numerical prediction models or based on pure time series input. Deep learning is appearing as a new method that can be used for wind energy prediction. This work develops several deep learning architectures and shows their performance when applied to wind time series. The models have been tested with the most extensive wind dataset available, the National Renewable Laboratory Wind Toolkit, a dataset with 126,692 wind points in North America. The architectures designed are based on different approaches, Multi-Layer Perceptron Networks (MLP), Convolutional Networks (CNN), and Recurrent Networks (RNN). These deep learning architectures have been tested to obtain predictions in a 12-h ahead horizon, and the accuracy is measured with the coefficient of determination, the R² method. The application of the models to wind sites evenly distributed in the North America geography allows us to infer several conclusions on the relationships between methods, terrain, and forecasting complexity. The results show differences between the models and confirm the superior capabilities on the use of deep learning techniques for wind speed forecasting from wind time series data.

[1]  G. Powers,et al.  A Description of the Advanced Research WRF Version 3 , 2008 .

[2]  Jing Shi,et al.  Bayesian adaptive combination of short-term wind speed forecasts from neural network models , 2011 .

[3]  Ulises Cortés,et al.  Predicting Wind Energy Generation with Recurrent Neural Networks , 2018, IDEAL.

[4]  Ingo Stadler,et al.  Cost minimization by optimization of electricity generation and demand side management , 2016, 2016 International Energy and Sustainability Conference (IESC).

[5]  Yoshua Bengio,et al.  Algorithms for Hyper-Parameter Optimization , 2011, NIPS.

[6]  M. Trovato,et al.  Risk-Constrained Profit Maximization in Day-Ahead Electricity Market , 2009, IEEE Transactions on Power Systems.

[7]  Kevin Leyton-Brown,et al.  Sequential Model-Based Optimization for General Algorithm Configuration , 2011, LION.

[8]  John Cristian Borges Gamboa,et al.  Deep Learning for Time-Series Analysis , 2017, ArXiv.

[9]  Wei Qiao,et al.  Support vector machine-based short-term wind power forecasting , 2011, 2011 IEEE/PES Power Systems Conference and Exposition.

[10]  Luai M. Al-Hadhrami,et al.  Pumped hydro energy storage system: A technological review , 2015 .

[11]  Yann Dauphin,et al.  Convolutional Sequence to Sequence Learning , 2017, ICML.

[12]  Qing Cao,et al.  Forecasting wind speed with recurrent neural networks , 2012, Eur. J. Oper. Res..

[13]  José R. Dorronsoro,et al.  Deep Neural Networks for Wind Energy Prediction , 2015, IWANN.

[14]  Wenzhong Gao,et al.  Wind power plant prediction by using neural networks , 2012, 2012 IEEE Energy Conversion Congress and Exposition (ECCE).

[15]  Vladlen Koltun,et al.  An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling , 2018, ArXiv.

[16]  Moritz Hardt,et al.  Stable Recurrent Models , 2018, ICLR.

[17]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[18]  Antti Sorjamaa,et al.  Multiple-output modeling for multi-step-ahead time series forecasting , 2010, Neurocomputing.

[19]  Huajie Zhang,et al.  An Empirical Study on Machine Learning Models for Wind Power Predictions , 2016, 2016 15th IEEE International Conference on Machine Learning and Applications (ICMLA).

[20]  Leo Breiman,et al.  Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author) , 2001 .

[21]  A. Moser,et al.  Modeling optimal redispatch for the European Transmission grid , 2011, 2011 IEEE Trondheim PowerTech.

[22]  M. Lange,et al.  Physical Approach to Short-Term Wind Power Prediction , 2005 .

[23]  Chresten Træholt,et al.  A review of Danish integrated multi-energy system flexibility options for high wind power penetration , 2017 .

[24]  Vatsal Sharan,et al.  Prediction with a short memory , 2016, STOC.

[25]  İnci Okumuş,et al.  Current status of wind energy forecasting and a hybrid method for hourly predictions , 2016 .

[26]  Gregor Giebel,et al.  The State-Of-The-Art in Short-Term Prediction of Wind Power. A Literature Overview , 2003 .

[27]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[28]  R.W. Dunn,et al.  One-hour-ahead wind speed prediction using a Bayesian methodology , 2006, 2006 IEEE Power Engineering Society General Meeting.

[29]  Andrew Kusiak,et al.  Renewables: Share data on wind energy , 2016, Nature.

[30]  Seref Sagiroglu,et al.  A new approach to very short term wind speed prediction using k-nearest neighbor classification , 2013 .

[31]  Hui Liu,et al.  Forecasting models for wind speed using wavelet, wavelet packet, time series and Artificial Neural Networks , 2013 .

[32]  Jing Shi,et al.  Evaluation of hybrid forecasting approaches for wind speed and power generation time series , 2012 .

[33]  Leo Breiman,et al.  Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author) , 2001, Statistical Science.

[34]  M. Lange On the Uncertainty of Wind Power Predictions—Analysis of the Forecast Accuracy and Statistical Distribution of Errors , 2005 .

[35]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[36]  P. Srinivasa Pai,et al.  Comparison of modeling methods for wind power prediction: a critical study , 2020 .

[37]  Theresa L. Utlaut,et al.  Introduction to Time Series Analysis and Forecasting , 2008 .

[38]  R. Barthelmie,et al.  Climate change impacts on wind energy: A review , 2010 .

[39]  Henrik Madsen,et al.  A review on the young history of the wind power short-term prediction , 2008 .

[40]  Rajesh Kumar Nema,et al.  A Critical Review on Wind Turbine Power Curve Modelling Techniques and Their Applications in Wind Based Energy Systems , 2016 .

[41]  Erasmo Cadenas,et al.  Wind speed forecasting using the NARX model, case: La Mata, Oaxaca, México , 2015, Neural Computing and Applications.

[42]  Jing Shi,et al.  On comparing three artificial neural networks for wind speed forecasting , 2010 .

[43]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[44]  Oliver Kramer,et al.  Machine learning ensembles for wind power prediction , 2016 .

[45]  Okyay Kaynak,et al.  Rough Deep Neural Architecture for Short-Term Wind Speed Forecasting , 2017, IEEE Transactions on Industrial Informatics.

[46]  Josep Maria Martorell Rodon Barcelona supercomputing center: science accelerator and producer of innovation , 2016 .

[47]  Bri-Mathias Hodge,et al.  The Wind Integration National Dataset (WIND) Toolkit , 2015 .

[48]  Jing Shi,et al.  Fine tuning support vector machines for short-term wind speed forecasting , 2011 .

[49]  Heiga Zen,et al.  WaveNet: A Generative Model for Raw Audio , 2016, SSW.

[50]  D. Ruppert The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[51]  Luis Enrique Sucar,et al.  Wind Power Forecasting Using Dynamic Bayesian Models , 2014, MICAI.

[52]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[53]  Amir F. Atiya,et al.  A Bias and Variance Analysis for Multistep-Ahead Time Series Forecasting , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[54]  Richard A. Russell,et al.  The coefficient of determination: what determines a useful R² statistic? , 2012, Investigative ophthalmology & visual science.