Building Energy Consumption Raw Data Forecasting Using Data Cleaning and Deep Recurrent Neural Networks

With the rising focus on building energy big data analysis, there lacks a framework for raw data preprocessing to answer the question of how to handle the missing data in the raw data set. This study presents a methodology and framework for building energy consumption raw data forecasting. A case building is used to forecast the energy consumption by using deep recurrent neural networks. Four different methodologies to impute missing data in the raw data set are compared and implemented. The question of sensitivity of gap size and available data percentage on the imputation accuracy was tested. The cleaned data were then used for building energy forecasting. While the existing studies explored only the use of small recurrent networks of 2 layers and less, the question of whether a deep network of more than 2 layers would be performing better for building energy consumption forecasting should be explored. In addition, the problem of overfitting has been cited as a significant problem in using deep networks. In this study, the deep recurrent neural network is then used to explore the use of deeper networks and their regularization in the context of an energy load forecasting task. The results show a mean absolute error of 2.1 can be achieved through the 2*32 gated neural network model. In applying regularization methods to overcome model overfitting, the study found that weights regularization did indeed delay the onset of overfitting.

[1]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[2]  Hui He,et al.  Short-Term Non-Residential Load Forecasting Based on Multiple Sequences LSTM Recurrent Neural Network , 2018, IEEE Access.

[3]  Jürgen Schmidhuber,et al.  LSTM can Solve Hard Long Time Lag Problems , 1996, NIPS.

[4]  Grigore Stamatescu,et al.  Deep Learning Techniques for Load Forecasting in Large Commercial Buildings , 2018, 2018 22nd International Conference on System Theory, Control and Computing (ICSTCC).

[5]  Nora El-Gohary,et al.  A review of data-driven building energy consumption prediction studies , 2018 .

[6]  Rizwan Ahmad,et al.  Intelligent techniques for forecasting electricity consumption of buildings , 2018, Energy.

[7]  Xiaohua Li,et al.  Electric load forecasting in smart grids using Long-Short-Term-Memory based Recurrent Neural Network , 2017, 2017 51st Annual Conference on Information Sciences and Systems (CISS).

[8]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[9]  Jie Gu,et al.  Short-term load forecasting using a long short-term memory network , 2017, 2017 IEEE PES Innovative Smart Grid Technologies Conference Europe (ISGT-Europe).

[10]  Yuan Zhang,et al.  Short-Term Residential Load Forecasting Based on LSTM Recurrent Neural Network , 2019, IEEE Transactions on Smart Grid.

[11]  Frank Hutter,et al.  SGDR: Stochastic Gradient Descent with Warm Restarts , 2016, ICLR.

[12]  Ran Li,et al.  Deep Learning for Household Load Forecasting—A Novel Pooling Deep RNN , 2018, IEEE Transactions on Smart Grid.

[13]  Chandra Sekhar,et al.  k-Shape clustering algorithm for building energy usage patterns analysis and forecasting model accuracy improvement , 2017 .

[14]  Mauro Conti,et al.  Computational intelligence approaches for energy load forecasting in smart energy management grids: state of the art, future challenges, and research directionsand Research Directions , 2018 .

[15]  Vivek Srikumar,et al.  Predicting electricity consumption for commercial and residential buildings using deep recurrent neural networks , 2018 .

[16]  Eduard Muljadi,et al.  A Short-Term and High-Resolution Distribution System Load Forecasting Approach Using Support Vector Regression With Hybrid Parameters Optimization , 2018, IEEE Transactions on Smart Grid.

[17]  José Manuel Benítez,et al.  On the use of cross-validation for time series predictor evaluation , 2012, Inf. Sci..

[18]  David J. Hill,et al.  Short-Term Residential Load Forecasting Based on Resident Behaviour Learning , 2018, IEEE Transactions on Power Systems.

[19]  Kun Yu,et al.  Short-term Power Load Forecasting of Residential Community Based on GRU Neural Network , 2018, 2018 International Conference on Power System Technology (POWERCON).

[20]  Jürgen Schmidhuber,et al.  Learning to forget: continual prediction with LSTM , 1999 .

[21]  Wojciech Zaremba,et al.  An Empirical Exploration of Recurrent Network Architectures , 2015, ICML.

[22]  François Chollet,et al.  Deep Learning with Python , 2017 .

[23]  J. Schafer,et al.  Missing data: our view of the state of the art. , 2002, Psychological methods.

[24]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[25]  Arun Sukumaran Nair,et al.  Residential Load Forecasting Using Deep Neural Networks (DNN) , 2018, 2018 North American Power Symposium (NAPS).

[26]  Guillaume Foggia,et al.  Neural Network-Based Model Design for Short-Term Load Forecast in Distribution Systems , 2016, IEEE Transactions on Power Systems.

[27]  Thomas Bartz-Beielstein,et al.  Comparison of different Methods for Univariate Time Series Imputation in R , 2015, ArXiv.

[28]  Pierluigi Siano,et al.  Demand response and smart grids—A survey , 2014 .

[29]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[30]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[31]  Fan Zhang,et al.  Time series forecasting for building energy consumption using weighted Support Vector Regression with differential evolution optimization technique , 2016 .

[32]  Arun Kumar Sangaiah,et al.  Smart grid load forecasting using online support vector regression , 2017, Comput. Electr. Eng..

[33]  Anton S. Boldyrev,et al.  Energy consumption prediction in urban areas for the smart city ecosystem , 2018, Remote Sensing.

[34]  Chirag Deb,et al.  Forecasting diurnal cooling energy load for institutional buildings using Artificial Neural Networks , 2016 .

[35]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[36]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[37]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[38]  L.A.L. de Almeida,et al.  Demand side management using artificial neural networks in a smart grid environment , 2015 .