Using Bayesian Deep Learning to Capture Uncertainty for Residential Net Load Forecasting

Decarbonization of electricity systems drives significant and continued investments in distributed energy sources to support the cost-effective transition to low-carbon energy systems. However, the rapid integration of distributed photovoltaic (PV) generation presents great challenges in obtaining reliable and secure grid operations because of its limited visibility and intermittent nature. Under this reality, net load forecasting is facing unprecedented difficulty in answering the following question: How can we accurately predict the net load while capturing the massive uncertainties arising from distributed PV generation and load, especially in the context of high PV penetration? This paper proposes a novel probabilistic day-ahead net load forecasting method to capture both epistemic uncertainty and aleatoric uncertainty using Bayesian deep learning, which is a new field that combines Bayesian probability theory and deep learning. The proposed methodological framework employs clustering in subprofiles and considers residential rooftop PV outputs as input features to enhance the performance of aggregated net load forecasting. Numerical experiments have been carried out based on fine-grained smart meter data from the Australian grid with separately recorded measurements of rooftop PV generation and loads. The results demonstrate the superior performance of the proposed scheme compared with a series of state-of-the-art methods and indicate the importance and effectiveness of subprofile clustering and high PV visibility.

[1]  Ning Zhang,et al.  Data-Driven Probabilistic Net Load Forecasting With High Penetration of Behind-the-Meter PV , 2018, IEEE Transactions on Power Systems.

[2]  Madeleine Gibescu,et al.  Deep learning for estimating building energy consumption , 2016 .

[3]  Goran Strbac,et al.  A Deep Learning-Based Feature Extraction Framework for System Security Assessment , 2019, IEEE Transactions on Smart Grid.

[4]  A. O'Hagan,et al.  Statistical Methods for Eliciting Probability Distributions , 2005 .

[5]  Jacek M. Zurada,et al.  Normalized Mutual Information Feature Selection , 2009, IEEE Transactions on Neural Networks.

[6]  Liu Jin,et al.  Short-term net feeder load forecasting of microgrid considering weather conditions , 2014, 2014 IEEE International Energy Conference (ENERGYCON).

[7]  Alex Kendall,et al.  What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision? , 2017, NIPS.

[8]  Chong-Ho Choi,et al.  Input feature selection for classification problems , 2002, IEEE Trans. Neural Networks.

[9]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[10]  V. Dordonnat,et al.  GEFCom2014 probabilistic electric load forecasting using time series and semi-parametric regression models , 2016 .

[11]  Steven R. Weller,et al.  Residential load and rooftop PV generation: an Australian distribution network dataset , 2017 .

[12]  Ran Li,et al.  Deep Learning for Household Load Forecasting—A Novel Pooling Deep RNN , 2018, IEEE Transactions on Smart Grid.

[13]  Abdul Motin Howlader,et al.  Very short term load forecasting of a distribution system with high PV penetration , 2017 .

[14]  J. H. Ward Hierarchical Grouping to Optimize an Objective Function , 1963 .

[15]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[16]  Pu Wang,et al.  Electric load forecasting with recency effect: A big data approach , 2016 .

[17]  Daniel Kirschen,et al.  Combining Probabilistic Load Forecasts , 2018, IEEE Transactions on Smart Grid.

[18]  Rob J. Hyndman,et al.  Forecasting Uncertainty in Electricity Smart Meter Data by Boosting Additive Quantile Regression , 2016, IEEE Transactions on Smart Grid.

[19]  S. C. Johnson Hierarchical clustering schemes , 1967, Psychometrika.

[20]  Thomas S. Huang,et al.  Dilated Recurrent Neural Networks , 2017, NIPS.

[21]  David J. Hill,et al.  Short-Term Residential Load Forecasting Based on Resident Behaviour Learning , 2018, IEEE Transactions on Power Systems.

[22]  Jun Hu,et al.  Short-Term Load Forecasting With Deep Residual Networks , 2018, IEEE Transactions on Smart Grid.

[23]  Tao Hong,et al.  A Naïve multiple linear regression benchmark for short term load forecasting , 2011, 2011 IEEE Power and Energy Society General Meeting.

[24]  Tao Hong,et al.  Probabilistic electric load forecasting: A tutorial review , 2016 .

[25]  Taher Niknam,et al.  Probabilistic Load Forecasting Using an Improved Wavelet Neural Network Trained by Generalized Extreme Learning Machine , 2018, IEEE Transactions on Smart Grid.

[26]  Tao Hong,et al.  Temperature Scenario Generation for Probabilistic Load Forecasting , 2018, IEEE Transactions on Smart Grid.

[27]  Shanlin Yang,et al.  A deep learning model for short-term power load and probability density forecasting , 2018, Energy.

[28]  Chongqing Kang,et al.  On Normality Assumption in Residual Simulation for Probabilistic Load Forecasting , 2017, IEEE Transactions on Smart Grid.

[29]  Navdeep Jaitly,et al.  Hybrid speech recognition with Deep Bidirectional LSTM , 2013, 2013 IEEE Workshop on Automatic Speech Recognition and Understanding.

[30]  P. Bromiley Products and Convolutions of Gaussian Probability Density Functions , 2013 .

[31]  A. Gelman Prior distributions for variance parameters in hierarchical models (comment on article by Browne and Draper) , 2004 .

[32]  Tao Hong,et al.  Probabilistic Load Forecasting via Quantile Regression Averaging on Sister Forecasts , 2017, IEEE Transactions on Smart Grid.

[33]  Hamidreza Zareipour,et al.  A New Feature Selection Technique for Load and Price Forecast of Electrical Power Systems , 2017, IEEE Transactions on Power Systems.

[34]  Goran Strbac,et al.  Clustering-Based Residential Baseline Estimation: A Probabilistic Perspective , 2019, IEEE Transactions on Smart Grid.

[35]  Ming-Wei Chang,et al.  Load forecasting using support vector Machines: a study on EUNITE competition 2001 , 2004, IEEE Transactions on Power Systems.

[36]  Nima Amjady,et al.  Design of input vector for day-ahead price forecasting of electricity markets , 2009, Expert Syst. Appl..

[37]  D. Mackay,et al.  Bayesian methods for adaptive models , 1992 .

[38]  Amanpreet Kaur,et al.  Net load forecasting for high renewable energy penetration grids , 2016 .

[39]  N. Amjady,et al.  Short-Term Bus Load Forecasting of Power Systems by a New Hybrid Method , 2007, IEEE Transactions on Power Systems.

[40]  Nima Amjady,et al.  Short-term hourly load forecasting using time-series modeling with peak load estimation capability , 2001 .

[41]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[42]  Qinghua Hu,et al.  Transfer learning for short-term wind speed prediction with deep neural networks , 2016 .

[43]  Yarin Gal,et al.  Uncertainty in Deep Learning , 2016 .

[44]  Dustin Tran,et al.  Edward: A library for probabilistic modeling, inference, and criticism , 2016, ArXiv.

[45]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[46]  Chongqing Kang,et al.  An Ensemble Forecasting Method for the Aggregated Load With Subprofiles , 2018, IEEE Transactions on Smart Grid.

[47]  Rob J Hyndman,et al.  Density Forecasting for Long-Term Peak Electricity Demand , 2010, IEEE Transactions on Power Systems.

[48]  Rob J Hyndman,et al.  Another look at measures of forecast accuracy , 2006 .

[49]  Ning Zhang,et al.  Probabilistic individual load forecasting using pinball loss guided LSTM , 2019, Applied Energy.

[50]  Dipti Srinivasan,et al.  An Improved Quantile Regression Neural Network for Probabilistic Load Forecasting , 2019, IEEE Transactions on Smart Grid.

[51]  Xi Zhang,et al.  Data-Driven Representative Day Selection for Investment Decisions: A Cost-Oriented Approach , 2019, IEEE Transactions on Power Systems.

[52]  P. McSharry,et al.  Probabilistic forecasts of the magnitude and timing of peak electricity demand , 2005, IEEE Transactions on Power Systems.

[53]  Dit-Yan Yeung,et al.  Towards Bayesian Deep Learning: A Framework and Some Existing Methods , 2016, IEEE Transactions on Knowledge and Data Engineering.