A VAE-Based Bayesian Bidirectional LSTM for Renewable Energy Forecasting

The advancement in distributed generation technologies in modern power systems has led to a widespread integration of renewable power generation at customer side. However, the intermittent nature of renewable energy pose new challenges to the network operational planning with underlying uncertainties. This paper proposes a novel Bayesian probabilistic technique for forecasting renewable power generation by addressing data and model uncertainties by integrating bidirectional long short-term memory (BiLSTM) neural networks while compressing the weight parameters using variational autoencoder (VAE). Existing Bayesian deep learning methods suffer from high computational complexities as they require to draw a large number of samples from weight parameters expressed in the form of probability distributions. The proposed method can deal with uncertainty present in model and data in a more computationally efficient manner by reducing the dimensionality of model parameters. The proposed method is evaluated using pinball loss, reconstruction error, and other forecasting evaluation metrics. It is inferred from the numerical results that VAE-Bayesian BiLSTM outperforms other probabilistic deep learning methods in terms of forecasting accuracy and computational efficiency for different sizes of the dataset.

[1]  Margarida Silveira,et al.  Unsupervised Anomaly Detection in Energy Time Series Data Using Variational Recurrent Autoencoders with Attention , 2018, 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA).

[2]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[3]  Nicholas Evans,et al.  Latent Representation Learning for Artificial Bandwidth Extension Using a Conditional Variational Auto-encoder , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  Yupu Yang,et al.  Variational Autoencoder Based Fault Detection and Location Method for Power Distribution Network , 2020, 2020 8th International Conference on Condition Monitoring and Diagnosis (CMD).

[5]  Shufang Li,et al.  Bayesian Deep Learning-Based Probabilistic Load Forecasting in Smart Grids , 2020, IEEE Transactions on Industrial Informatics.

[6]  Yi Wang,et al.  Review of Smart Meter Data Analytics: Applications, Methodologies, and Challenges , 2018, IEEE Transactions on Smart Grid.

[7]  Yuan Zhang,et al.  Short-Term Residential Load Forecasting Based on LSTM Recurrent Neural Network , 2019, IEEE Transactions on Smart Grid.

[8]  Thomas Carriere,et al.  A Novel Approach for Seamless Probabilistic Photovoltaic Power Forecasting Covering Multiple Time Frames , 2020, IEEE Transactions on Smart Grid.

[9]  Kit Po Wong,et al.  Probabilistic Forecasting of Wind Power Generation Using Extreme Learning Machine , 2014, IEEE Transactions on Power Systems.

[10]  Nadarajah Mithulananthan,et al.  Solar output power forecast using an ensemble framework with neural predictors and Bayesian adaptive combination , 2018 .

[11]  Hedvig Kjellström,et al.  Advances in Variational Inference , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[13]  Virgilio A. Centeno,et al.  DeVLearn: A Deep Visual Learning Framework for Determining the Location of Temporary Faults in Power Systems , 2020, 2020 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids (SmartGridComm).

[14]  Yi Wang,et al.  Using Bayesian Deep Learning to Capture Uncertainty for Residential Net Load Forecasting , 2020, IEEE Transactions on Power Systems.

[15]  Dhivya Sampath Kumar,et al.  Review of power system impacts at high PV penetration Part I: Factors limiting PV penetration , 2020 .

[16]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[17]  Sofiane Khadraoui,et al.  Short-Term Forecasting of Photovoltaic Solar Power Production Using Variational Auto-Encoder Driven Deep Learning Approach , 2020 .

[18]  Md. Apel Mahmud,et al.  Energy Forecasting in Smart Grid Systems: A Review of the State-of-the-art Techniques , 2020, ArXiv.

[19]  Xiaoning Zhang,et al.  Probabilistic Solar Irradiation Forecasting Based on Variational Bayesian Inference With Secure Federated Learning , 2021, IEEE Transactions on Industrial Informatics.

[20]  Magdy M. A. Salama,et al.  Distributed generation technologies, definitions and benefits , 2004 .

[21]  Vladimiro Miranda,et al.  Probabilistic solar power forecasting in smart grids using distributed information , 2015 .

[22]  Xiang Yu,et al.  Ensemble spatiotemporal forecasting of solar irradiation using variational Bayesian convolutional gate recurrent unit network , 2019, Applied Energy.

[23]  Adel Mellit,et al.  Prediction of daily global solar irradiation data using Bayesian neural network: A comparative study , 2012 .

[24]  Jean-François Toubeau,et al.  Deep Learning-Based Multivariate Probabilistic Forecasting for Short-Term Scheduling in Power Markets , 2019, IEEE Transactions on Power Systems.

[25]  Zhi Zhou,et al.  A Nonparametric Bayesian Framework for Short-Term Wind Power Probabilistic Forecast , 2019, IEEE Transactions on Power Systems.

[26]  Fengqi You,et al.  Data-Driven Adaptive Robust Unit Commitment Under Wind Power Uncertainty: A Bayesian Nonparametric Approach , 2019, IEEE Transactions on Power Systems.

[27]  Alex Kendall,et al.  What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision? , 2017, NIPS.

[28]  Zoubin Ghahramani,et al.  Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning , 2015, ICML.

[29]  Yarin Gal,et al.  Uncertainty in Deep Learning , 2016 .

[30]  Ran Li,et al.  Deep Learning for Household Load Forecasting—A Novel Pooling Deep RNN , 2018, IEEE Transactions on Smart Grid.

[31]  Guido Carpinelli,et al.  A Bayesian-Based Approach for a Short-Term Steady-State Forecast of a Smart Grid , 2013, IEEE Transactions on Smart Grid.

[32]  Mohsen Guizani,et al.  Smart Grid Energy Management Using RNN-LSTM: A Deep Learning-Based Approach , 2019, 2019 IEEE Global Communications Conference (GLOBECOM).

[33]  Farshid Keynia,et al.  Short-term wind power forecasting using ridgelet neural network , 2011 .