Building energy load forecasting using Deep Neural Networks

Ensuring sustainability demands more efficient energy management with minimized energy wastage. Therefore, the power grid of the future should provide an unprecedented level of flexibility in energy management. To that end, intelligent decision making requires accurate predictions of future energy demand/load, both at aggregate and individual site level. Thus, energy load forecasting have received increased attention in the recent past. However, it has proven to be a difficult problem. This paper presents a novel energy load forecasting methodology based on Deep Neural Networks, specifically, Long Short Term Memory (LSTM) algorithms. The presented work investigates two LSTM based architectures: 1) standard LSTM and 2) LSTM-based Sequence to Sequence (S2S) architecture. Both methods were implemented on a benchmark data set of electricity consumption data from one residential customer. Both architectures were trained and tested on one hour and one-minute time-step resolution datasets. Experimental results showed that the standard LSTM failed at one-minute resolution data while performing well in one-hour resolution data. It was shown that S2S architecture performed well on both datasets. Further, it was shown that the presented methods produced comparable results with the other deep learning methods for energy forecasting in literature.

[1]  Rajesh Kumar,et al.  Energy analysis of a building using artificial neural network: A review , 2013 .

[2]  Geoffrey E. Hinton,et al.  Two Distributed-State Models For Generating High-Dimensional Time Series , 2011, J. Mach. Learn. Res..

[3]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[4]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[5]  Xin Yao,et al.  Short-Term Load Forecasting with Neural Network Ensembles: A Comparative Study [Application Notes] , 2011, IEEE Computational Intelligence Magazine.

[6]  Shahaboddin Shamshirband,et al.  Estimating building energy consumption using extreme learning machine method , 2016 .

[7]  Davide Anguita,et al.  Energy Load Forecasting Using Empirical Mode Decomposition and Support Vector Regression , 2013, IEEE Transactions on Smart Grid.

[8]  Ronald J. Williams,et al.  Gradient-based learning algorithms for recurrent networks and their computational complexity , 1995 .

[9]  Milos Manic,et al.  Artificial neural networks based thermal energy storage control for buildings , 2015, IECON 2015 - 41st Annual Conference of the IEEE Industrial Electronics Society.

[10]  Z. Baharudin,et al.  A review on short term load forecasting using hybrid neural network techniques , 2012, 2012 IEEE International Conference on Power and Energy (PECon).

[11]  Ronald J. Williams,et al.  Gradient-Based Learning Algorithms for Recurrent Networks , 1989 .

[12]  Madeleine Gibescu,et al.  Deep learning for estimating building energy consumption , 2016 .

[13]  Wei-Peng Chen,et al.  Neural network model ensembles for building-level electricity load forecasts , 2014 .

[14]  Paul J. Werbos,et al.  Backpropagation Through Time: What It Does and How to Do It , 1990, Proc. IEEE.

[15]  Jaime Lloret,et al.  A Survey on Electric Power Demand Forecasting: Future Trends in Smart Grids, Microgrids and Smart Buildings , 2014, IEEE Communications Surveys & Tutorials.

[16]  Luis Pérez-Lombard,et al.  A review on buildings energy consumption information , 2008 .

[17]  Geoffrey E. Hinton,et al.  Conditional Restricted Boltzmann Machines for Structured Output Prediction , 2011, UAI.

[18]  Arunesh Kumar Singh,et al.  Load forecasting techniques and methodologies: A review , 2012, 2012 2nd International Conference on Power, Control and Embedded Systems.

[19]  Christopher Kermorvant,et al.  Dropout Improves Recurrent Neural Networks for Handwriting Recognition , 2013, 2014 14th International Conference on Frontiers in Handwriting Recognition.

[20]  C. Clastres Smart grids: Another step towards competition, energy security and climate change objectives , 2011 .

[21]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[22]  Razvan Pascanu,et al.  On the difficulty of training recurrent neural networks , 2012, ICML.

[23]  Jean-Baptiste Fiot,et al.  Electricity Demand Forecasting by Multi-Task Learning , 2015, IEEE Transactions on Smart Grid.

[24]  Milos Manic,et al.  Data-fusion for increasing temporal resolution of building energy management system data , 2015, IECON 2015 - 41st Annual Conference of the IEEE Industrial Electronics Society.

[25]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[26]  Guillermo Escrivá-Escrivá,et al.  Upgrade of an artificial neural network prediction method for electrical consumption forecasting using an hourly temperature curve model , 2013 .

[27]  Tin Kam Ho,et al.  A Sparse Coding Approach to Household Electricity Demand Forecasting in Smart Grids , 2017, IEEE Transactions on Smart Grid.

[28]  Pierluigi Siano,et al.  Demand response and smart grids—A survey , 2014 .