Deep neural networks for energy load forecasting

Smartgrids of the future promise unprecedented flexibility in energy management. Therefore, accurate predictions/forecasts of energy demands (loads) at individual site and aggregate level of the grid is crucial. Despite extensive research, load forecasting remains to be a difficult problem. This paper presents a load forecasting methodology based on deep learning. Specifically, the work presented in this paper investigates the effectiveness of using Convolutional Neural Networks (CNN) for performing energy load forecasting at individual building level. The presented methodology uses convolutions on historical loads. The output from the convolutional operation is fed to fully connected layers together with other pertinent information. The presented methodology was implemented on a benchmark data set of electricity consumption for a single residential customer. Results obtained from the CNN were compared against results obtained by Long Short Term Memories LSTM sequence-to-sequence (LSTM S2S), Factored Restricted Boltzmann Machines (FCRBM), “shallow” Artificial Neural Networks (ANN) and Support Vector Machines (SVM) for the same dataset. Experimental results showed that the CNN outperformed SVR while producing comparable results to the ANN and deep learning methodologies. Further testing is required to compare the performances of different deep learning architectures in load forecasting.

[1]  Tin Kam Ho,et al.  A Sparse Coding Approach to Household Electricity Demand Forecasting in Smart Grids , 2017, IEEE Transactions on Smart Grid.

[2]  Ljupco Kocarev,et al.  Deep belief network based electricity load forecasting: An analysis of Macedonian case , 2016 .

[3]  Milos Manic,et al.  Intelligent Buildings of the Future: Cyberaware, Deep Learning Powered, and Human Interacting , 2016, IEEE Industrial Electronics Magazine.

[4]  Geoffrey E. Hinton,et al.  Conditional Restricted Boltzmann Machines for Structured Output Prediction , 2011, UAI.

[5]  Arunesh Kumar Singh,et al.  Load forecasting techniques and methodologies: A review , 2012, 2012 2nd International Conference on Power, Control and Embedded Systems.

[6]  Geoffrey E. Hinton,et al.  Two Distributed-State Models For Generating High-Dimensional Time Series , 2011, J. Mach. Learn. Res..

[7]  C. Clastres Smart grids: Another step towards competition, energy security and climate change objectives , 2011 .

[8]  Rajesh Kumar,et al.  Energy analysis of a building using artificial neural network: A review , 2013 .

[9]  Luis Pérez-Lombard,et al.  A review on buildings energy consumption information , 2008 .

[10]  Pierluigi Siano,et al.  Demand response and smart grids—A survey , 2014 .

[11]  Milos Manic,et al.  Artificial neural networks based thermal energy storage control for buildings , 2015, IECON 2015 - 41st Annual Conference of the IEEE Industrial Electronics Society.

[12]  P. Aruna Jeyanthy,et al.  Artificial neural network based day ahead load forecasting using Smart Meter data , 2016, 2016 Biennial International Conference on Power and Energy Systems: Towards Sustainable Energy (PESTSE).

[13]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[14]  Xin Yao,et al.  Short-Term Load Forecasting with Neural Network Ensembles: A Comparative Study [Application Notes] , 2011, IEEE Computational Intelligence Magazine.

[15]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[16]  Madeleine Gibescu,et al.  Deep learning for estimating building energy consumption , 2016 .

[17]  Jaime Lloret,et al.  A Survey on Electric Power Demand Forecasting: Future Trends in Smart Grids, Microgrids and Smart Buildings , 2014, IEEE Communications Surveys & Tutorials.

[18]  Milos Manic,et al.  Data-fusion for increasing temporal resolution of building energy management system data , 2015, IECON 2015 - 41st Annual Conference of the IEEE Industrial Electronics Society.

[19]  Shahaboddin Shamshirband,et al.  Estimating building energy consumption using extreme learning machine method , 2016 .

[20]  Davide Anguita,et al.  Energy Load Forecasting Using Empirical Mode Decomposition and Support Vector Regression , 2013, IEEE Transactions on Smart Grid.

[21]  Daniel L. Marino,et al.  Building energy load forecasting using Deep Neural Networks , 2016, IECON 2016 - 42nd Annual Conference of the IEEE Industrial Electronics Society.

[22]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[23]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[24]  Le Zhang,et al.  Ensemble deep learning for regression and time series forecasting , 2014, 2014 IEEE Symposium on Computational Intelligence in Ensemble Learning (CIEL).

[25]  Z. Baharudin,et al.  A review on short term load forecasting using hybrid neural network techniques , 2012, 2012 IEEE International Conference on Power and Energy (PECon).

[26]  Milos Manic,et al.  Building Energy Management Systems: The Age of Intelligent and Adaptive Buildings , 2016, IEEE Industrial Electronics Magazine.

[27]  Jean-Baptiste Fiot,et al.  Electricity Demand Forecasting by Multi-Task Learning , 2015, IEEE Transactions on Smart Grid.

[28]  Wei-Peng Chen,et al.  Neural network model ensembles for building-level electricity load forecasts , 2014 .

[29]  Guillermo Escrivá-Escrivá,et al.  Upgrade of an artificial neural network prediction method for electrical consumption forecasting using an hourly temperature curve model , 2013 .