Temporal convolutional networks interval prediction model for wind speed forecasting

Abstract Wind speed interval prediction is one of the most elusive and long-standing challenges in wind power production. As a data source with intermittent and fluctuant characteristics, wind speed time series require highly nonlinear temporal features for the prediction tasks. In this paper, a novel interval prediction model is proposed based on temporal convolutional networks to forecast wind speed. A temporal convolutional networks architecture layer, multiple fully connected layers using tanh activation function and an end-to-end sorting layer are respectively served as input, hidden and output layers of the temporal convolutional networks interval prediction model which can generate prediction intervals directly. Additionally, an adaptive interval construction optimization strategy is put forward to devise training labels for learning of model. Eight cases from two wind fields are implemented to test and verify the proposed method. Specially, experiments have been designed to compare the prediction accuracy and reliability between the proposed model and the most recent state-of-the-art models. The forecasting results suggest that the proposed model has a significant performance improvement on both prediction interval coverage probability and prediction interval width criteria and thus can be a practical tool for wind speed forecasting.

[1]  Kit Po Wong,et al.  Electricity Price Forecasting With Extreme Learning Machine and Bootstrapping , 2012, IEEE Transactions on Power Systems.

[2]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[3]  Bijaya K. Panigrahi,et al.  Prediction Interval Estimation of Electricity Prices Using PSO-Tuned Support Vector Machines , 2015, IEEE Transactions on Industrial Informatics.

[4]  Sun Jianb Wind Power Interval Prediction Based on Non-parametric Kernel Density Estimation , 2013 .

[5]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[6]  Naomi S. Altman,et al.  Quantile regression , 2019, Nature Methods.

[7]  Liping Xie,et al.  Direct interval forecasting of wind speed using radial basis function neural networks in a multi-objective optimization framework , 2016, Neurocomputing.

[8]  A. Weigend,et al.  Estimating the mean and variance of the target probability distribution , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[9]  Jian Weng,et al.  A Two-Layer Nonlinear Combination Method for Short-Term Wind Speed Prediction Based on ELM, ENN, and LSTM , 2019, IEEE Internet of Things Journal.

[10]  Durga L. Shrestha,et al.  Machine learning approaches for estimation of prediction interval for the model output , 2006, Neural Networks.

[11]  Jianhui Wang,et al.  Interval Deep Generative Neural Network for Wind Speed Forecasting , 2019, IEEE Transactions on Smart Grid.

[12]  Jun Lu,et al.  Construction of prediction intervals for carbon residual of crude oil based on deep stochastic configuration networks , 2019, Inf. Sci..

[13]  G.N. Kariniotakis,et al.  Probabilistic Short-term Wind Power Forecasting for the Optimal Management of Wind Generation , 2007, 2007 IEEE Lausanne Power Tech.

[14]  Gabor Kereszturi,et al.  Determining Uncertainty Prediction Map of Copper Concentration in Pasture from Hyperspectral Data Using Qunatile Regression Forest , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[15]  Zhang Yan,et al.  A review on the forecasting of wind speed and generated power , 2009 .

[16]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Abheejeet Mohapatra,et al.  Repeated wavelet transform based ARIMA model for very short-term wind speed forecasting , 2019, Renewable Energy.

[18]  Amir F. Atiya,et al.  Lower Upper Bound Estimation Method for Construction of Neural Network-Based Prediction Intervals , 2011, IEEE Transactions on Neural Networks.

[19]  Saeid Nahavandi,et al.  Prediction Intervals to Account for Uncertainties in Travel Time Prediction , 2011, IEEE Transactions on Intelligent Transportation Systems.

[20]  Tao Hong,et al.  Probabilistic electric load forecasting: A tutorial review , 2016 .

[21]  Xiaoming Xue,et al.  Short-Term Wind Speed Interval Prediction Based on Ensemble GRU Model , 2020, IEEE Transactions on Sustainable Energy.

[22]  Abbas Khosravi,et al.  Particle swarm optimization for construction of neural network-based prediction intervals , 2014, Neurocomputing.

[23]  Jianhui Wang,et al.  Spatio-Temporal Graph Deep Neural Network for Short-Term Wind Speed Forecasting , 2019, IEEE Transactions on Sustainable Energy.

[24]  Jing Deng,et al.  Hybrid Probabilistic Wind Power Forecasting Using Temporally Local Gaussian Process , 2016, IEEE Transactions on Sustainable Energy.

[25]  DeLiang Wang,et al.  TCNN: Temporal Convolutional Neural Network for Real-time Speech Enhancement in the Time Domain , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[26]  Abbas Khosravi,et al.  Short-Term Load and Wind Power Forecasting Using Neural Network-Based Prediction Intervals , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[27]  Saeid Nahavandi,et al.  Prediction Interval Construction and Optimization for Adaptive Neurofuzzy Inference Systems , 2011, IEEE Transactions on Fuzzy Systems.

[28]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[29]  Jianzhong Zhou,et al.  Probabilistic spatiotemporal wind speed forecasting based on a variational Bayesian deep learning model , 2020 .

[30]  Jun Wang,et al.  Multivariate Temporal Convolutional Network: A Deep Neural Networks Approach for Multivariate Time Series Forecasting , 2019, Electronics.