Statistical Learning versus Deep Learning: Performance Comparison for Building Energy Prediction Methods

In this paper, deep learning methods are compared with traditional statistical learning approaches for the purpose of accurately predicting the electrical energy consumption at the building level. Despite the fact that a wide range of machine learning methods have already been applied to energy prediction, deep learning methods certainly represent the state-of-the-art in artificial intelligence, and have been used with remarkable success in a wide range of applications. In particular, the use of Deep Belief Network (DBN), Multi Layer Perceptron and Artificial Neural Network methods are considered in this work. Furthermore, deep learning performance is compared with the most commonly used statistical learning methods, such as Support Vector Machines, Hidden Markov Models and Factored Hidden Markov Models. The analysis of the day-ahead and weekahead energy prediction demonstrates that different prediction methods present significantly different levels of accuracy, with the DBN offering the most consistent performance over various lookahead horizons and resolutions. The methods are validated with the Pecan Street large-scale dataset that comprises an interesting mix of consumer behaviors, electrical vehicles and photovoltaic generation.

[1]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[2]  Madeleine Gibescu,et al.  Demand forecasting at low aggregation levels using Factored Conditional Restricted Boltzmann Machine , 2016, 2016 Power Systems Computation Conference (PSCC).

[3]  Frank Rosenblatt,et al.  PRINCIPLES OF NEURODYNAMICS. PERCEPTRONS AND THE THEORY OF BRAIN MECHANISMS , 1963 .

[4]  Illia Horenko,et al.  Dimension Reduction for Time Series with Hidden Phase Transitions and Economic Applications , 2008 .

[5]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[6]  Yuan Zhang,et al.  Short-Term Residential Load Forecasting Based on LSTM Recurrent Neural Network , 2019, IEEE Transactions on Smart Grid.

[7]  Antonio Liotta,et al.  On-Line Building Energy Optimization Using Deep Reinforcement Learning , 2017, IEEE Transactions on Smart Grid.

[8]  Daniel L. Marino,et al.  Building energy load forecasting using Deep Neural Networks , 2016, IECON 2016 - 42nd Annual Conference of the IEEE Industrial Electronics Society.

[9]  Manuel Berenguel,et al.  A Comparison of Energy Consumption Prediction Models Based on Neural Networks of a Bioclimatic Building , 2016 .

[10]  L. Suganthi,et al.  Energy models for demand forecasting—A review , 2012 .

[11]  Geoffrey E. Hinton,et al.  Two Distributed-State Models For Generating High-Dimensional Time Series , 2011, J. Mach. Learn. Res..

[12]  Hongseok Kim,et al.  Deep neural network based demand side short term load forecasting , 2016, 2016 IEEE International Conference on Smart Grid Communications (SmartGridComm).

[13]  Zoubin Ghahramani,et al.  An Introduction to Hidden Markov Models and Bayesian Networks , 2001, Int. J. Pattern Recognit. Artif. Intell..

[14]  S. Eddy Hidden Markov models. , 1996, Current opinion in structural biology.

[15]  Milos Manic,et al.  Intelligent Buildings of the Future: Cyberaware, Deep Learning Powered, and Human Interacting , 2016, IEEE Industrial Electronics Magazine.

[16]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[17]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[18]  Antonio Liotta,et al.  A topological insight into restricted Boltzmann machines , 2016, Machine Learning.

[19]  Wil L. Kling,et al.  Comparison of machine learning methods for estimating energy consumption in buildings , 2014, 2014 International Conference on Probabilistic Methods Applied to Power Systems (PMAPS).

[20]  Léon Bottou,et al.  The Tradeoffs of Large Scale Learning , 2007, NIPS.

[21]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1989, Math. Control. Signals Syst..

[22]  Peter Stone,et al.  Scalable training of artificial neural networks with adaptive sparse connectivity inspired by network science , 2017, Nature Communications.

[23]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[24]  Andrea Costa,et al.  Building operation and energy performance: Monitoring, analysis and optimisation toolkit , 2013 .

[25]  Madeleine Gibescu,et al.  Deep learning for estimating building energy consumption , 2016 .

[26]  Nikolaos G. Paterakis,et al.  Deep learning versus traditional machine learning methods for aggregated energy demand prediction , 2017, 2017 IEEE PES Innovative Smart Grid Technologies Conference Europe (ISGT-Europe).