A Neural Ordinary Differential Equations Based Approach for Demand Forecasting within Power Grid Digital Twins

Over the past few years, deep learning (DL) based electricity demand forecasting has received considerable attention amongst mathematicians, engineers and data scientists working within the smart grid domain. To this end, deep learning architectures such as deep neural networks (DNN), deep belief networks (DBN) and recurrent neural networks (RNN) have been successfully applied to forecast the generation and consumption of a wide range of energy vectors. In this work, we show preliminary results for a residential load demand forecasting solution which is realized within the framework of power grid digital twin. To this end, a novel class of deep neural networks is adopted wherein the output of the network is efficiently computed via a black-box ordinary differential equation (ODE) solver. We introduce the readers to the main concepts behind this method followed by a real-world, data driven computational benchmark test case designed to study the numerical effectiveness of the proposed approach. Initial results suggest that the ODE based solutions yield acceptable levels of accuracy for wide range of prediction horizons. We conclude that the method could prove as a valuable tool to develop forecasting models within an electrical digital twin (EDT) framework, where, in addition to accurate prediction models, a time horizon independent, computationally scalable and compact model is often desired.

[1]  Ram Rajagopal,et al.  A scaling law for short term load forecasting on varying levels of aggregation , 2018, International Journal of Electrical Power & Energy Systems.

[2]  G. Jang,et al.  Short-term load forecasting for the holidays using fuzzy linear regression method , 2005, IEEE Transactions on Power Systems.

[3]  Philip Woodall,et al.  Developing a Dynamic Digital Twin at a Building Level: using Cambridge Campus as Case Study , 2019, International Conference on Smart Infrastructure and Construction 2019 (ICSIC).

[4]  David Duvenaud,et al.  Neural Ordinary Differential Equations , 2018, NeurIPS.

[5]  Amy Loutfi,et al.  A review of unsupervised feature learning and deep learning for time-series modeling , 2014, Pattern Recognit. Lett..

[6]  Tin Kam Ho,et al.  A Sparse Coding Approach to Household Electricity Demand Forecasting in Smart Grids , 2017, IEEE Transactions on Smart Grid.

[7]  Maria Lorena Tuballa,et al.  A review of the development of Smart Grid technologies , 2016 .

[8]  P. McSharry,et al.  Short-Term Load Forecasting Methods: An Evaluation Based on European Data , 2007, IEEE Transactions on Power Systems.

[9]  Tin Kam Ho,et al.  Demand forecasting in smart grids , 2014, Bell Labs Technical Journal.

[10]  Dongxiao Niu,et al.  Short-Term Power Load Forecasting Using Least Squares Support Vector Machines(LS-SVM) , 2009, 2009 Second International Workshop on Computer Science and Engineering.

[11]  Souhaib Ben Taieb,et al.  A gradient boosting approach to the Kaggle load forecasting competition , 2014 .

[12]  Krzysztof Siwek,et al.  Ensemble Neural Network Approach for Accurate Load Forecasting in a Power System , 2009, Int. J. Appl. Math. Comput. Sci..

[13]  S. Osowski,et al.  Blind source separation for improved load forecasting in the power system , 2005, Proceedings of the 2005 European Conference on Circuit Theory and Design, 2005..

[14]  James W. Taylor,et al.  Triple seasonal methods for short-term electricity demand forecasting , 2010, Eur. J. Oper. Res..

[15]  Jun Liang,et al.  Residual Recurrent Neural Networks for Learning Sequential Representations , 2018, Inf..

[16]  Jin Wen,et al.  A systematic feature selection procedure for short-term data-driven building energy forecasting model development , 2019, Energy and Buildings.

[17]  A. B. M. Shawkat Ali,et al.  Demand Forecasting in Smart Grid , 2013 .

[18]  Krzysztof Gajowniczek,et al.  Electricity forecasting on the individual household level enhanced based on activity patterns , 2017, PloS one.

[19]  Pilsung Kang,et al.  Recurrent Neural Network-Based Semantic Variational Autoencoder for Sequence-to-Sequence Learning , 2018, Inf. Sci..

[20]  Ryszard Szupiluk,et al.  Combining Forecasts with Blind Signal Separation Methods in Electric Load Prediction Framework , 2006, Artificial Intelligence and Applications.

[21]  Yacine Rezgui,et al.  Trees vs Neurons: Comparison between random forest and ANN for high-resolution prediction of building energy consumption , 2017 .

[22]  V. Lo Brano,et al.  Forecasting daily urban electric load profiles using artificial neural networks , 2004 .

[23]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[24]  Yuan Zhang,et al.  Short-Term Residential Load Forecasting Based on LSTM Recurrent Neural Network , 2019, IEEE Transactions on Smart Grid.

[25]  Ran Li,et al.  Deep Learning for Household Load Forecasting—A Novel Pooling Deep RNN , 2018, IEEE Transactions on Smart Grid.

[26]  Chao Sun,et al.  Nonlinear Predictive Energy Management of Residential Buildings with Photovoltaics & Batteries , 2016 .

[27]  Karl Aberer,et al.  Electricity load forecasting for residential customers: Exploiting aggregation and correlation between households , 2013, 2013 Sustainable Internet and ICT for Sustainability (SustainIT).

[28]  Krzysztof Gajowniczek,et al.  Data Mining Techniques for Detecting Household Characteristics Based on Smart Meter Data , 2015 .

[29]  Fredrik Wallin,et al.  Forecasting for demand response in smart grids: An analysis on use of anthropologic and structural data and short term multiple loads forecasting , 2012 .

[30]  Maria Grazia De Giorgi,et al.  Comparison Between Wind Power Prediction Models Based on Wavelet Decomposition with Least-Squares Support Vector Machine (LS-SVM) and Artificial Neural Network (ANN) , 2014 .