Trees vs Neurons: Comparison between random forest and ANN for high-resolution prediction of building energy consumption

Energy prediction models are used in buildings as a performance evaluation engine in advanced control and optimisation, and in making informed decisions by facility managers and utilities for enhanced energy efficiency. Simplified and data-driven models are often the preferred option where pertinent information for detailed simulation are not available and where fast responses are required. We compared the performance of the widely-used feed-forward back-propagation artificial neural network (ANN) with random forest (RF), an ensemble-based method gaining popularity in prediction – for predicting the hourly HVAC energy consumption of a hotel in Madrid, Spain. Incorporating social parameters such as the numbers of guests marginally increased prediction accuracy in both cases. Overall, ANN performed marginally better than RF with root-mean-square error (RMSE) of 4.97 and 6.10 respectively. However, the ease of tuning and modelling with categorical variables offers ensemble-based algorithms an advantage for dealing with multi-dimensional complex data, typical in buildings. RF performs internal cross-validation (i.e. using out-of-bag samples) and only has a few tuning parameters. Both models have comparable predictive power and nearly equally applicable in building energy applications.

[1]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[2]  Pierre Geurts,et al.  Extremely randomized trees , 2006, Machine Learning.

[3]  David S. Siroky.  Navigating Random Forests and related advances in algorithmic modeling , 2009 .

[4]  Moncef Krarti,et al.  Building Energy Use Prediction and System Identification Using Recurrent Neural Networks , 1995 .

[5]  Taehoon Hong,et al.  A decision support model for reducing electric energy consumption in elementary school facilities , 2012 .

[6]  Miriam A. M. Capretz,et al.  Energy Forecasting for Event Venues: Big Data and Prediction Accuracy , 2016 .

[7]  Yacine Rezgui,et al.  Optimising the scheduled operation of window blinds to enhance occupant comfort , 2015 .

[8]  Jin Wen,et al.  Review of building energy modeling for control and operation , 2014 .

[9]  David G. Stork,et al.  Pattern Classification , 1973 .

[10]  Michael Conlon,et al.  A clustering approach to domestic electricity load profile characterisation using smart metering data , 2015 .

[11]  Denis Kelliher,et al.  Integrating building energy simulation in the design process , 2003 .

[12]  Yan Cheng-wen,et al.  Application of ANN for the prediction of building energy consumption at different climate zones with HDD and CDD , 2010, 2010 2nd International Conference on Future Computer and Communication.

[13]  Ali Azadeh,et al.  Annual electricity consumption forecasting by neural network in high energy consuming industrial sectors , 2008 .

[14]  Yacine Rezgui,et al.  Computational intelligence techniques for HVAC systems: A review , 2016, Building Simulation.

[15]  Soteris A. Kalogirou,et al.  Artificial neural networks for the prediction of the energy consumption of a passive solar building , 2000 .

[16]  Robert J. Marks,et al.  Neural Smithing: Supervised Learning in Feedforward Artificial Neural Networks , 1999 .

[17]  Yacine Rezgui,et al.  Optimal scheduling strategy for enhancing IAQ, visual and thermal comfort using a genetic algorithm , 2016 .

[18]  Robert P. Sheridan,et al.  Random Forest: A Classification and Regression Tool for Compound Classification and QSAR Modeling , 2003, J. Chem. Inf. Comput. Sci..

[19]  Luis Pérez-Lombard,et al.  A review on buildings energy consumption information , 2008 .

[20]  Hecht-Nielsen.  Theory of the backpropagation neural network , 1989 .

[21]  Abdullatif Ben-Nakhi,et al.  Cooling load prediction for buildings using general regression neural networks , 2004 .

[22]  Benjamin C. M. Fung,et al.  A decision tree method for building energy demand modeling , 2010 .

[23]  Jiejin Cai,et al.  Predicting hourly cooling load in the building: A comparison of support vector machine and different artificial neural networks , 2009 .

[24]  Guido Bugmann,et al.  NEURAL NETWORK DESIGN FOR ENGINEERING APPLICATIONS , 2001 .

[25]  Ibrahim Dincer,et al.  Heat transfer analysis of phase change process in a finned-tube thermal energy storage system using artificial neural network , 2007 .

[26]  Shengwei Wang,et al.  Development of prediction models for next-day building energy consumption and peak power demand using data mining techniques , 2014 .

[27]  Yacine Rezgui,et al.  Building energy metering and environmental monitoring – A state-of-the-art review and directions for future research , 2016 .

[28]  Sophia Ananiadou,et al.  Normalizing biomedical terms by minimizing ambiguity and variability , 2008, BMC Bioinformatics.

[29]  Constantin F. Aliferis,et al.  A comprehensive comparison of random forests and support vector machines for microarray-based cancer classification , 2008, BMC Bioinformatics.

[30]  Taehoon Hong,et al.  A decision support model for improving a multi-family housing complex based on CO2 emission from gas energy consumption , 2012 .

[31]  Kelvin K. W. Yau,et al.  Predicting electricity energy consumption: A comparison of regression analysis, decision tree and neural networks , 2007 .

[32]  Rui Jiang,et al.  A random forest approach to the detection of epistatic interactions in case-control studies , 2009, BMC Bioinformatics.

[33]  Yacine Rezgui,et al.  Smart Grid Futures: Perspectives on the Integration of Energy and ICT Services , 2015 .

[34]  Tao Jiang,et al.  Computational prediction of novel non-coding RNAs in Arabidopsis thaliana , 2009, BMC Bioinformatics.

[35]  S. Vincenzi,et al.  Application of a Random Forest algorithm to predict spatial distribution of the potential yield of Ruditapes philippinarum in the Venice lagoon, Italy , 2011 .

[36]  Jose C. Principe,et al.  Neural and Adaptive Systems: Fundamentals through Simulations with CD-ROM , 1999 .

[37]  Lynne E. Parker,et al.  Energy and Buildings , 2012 .

[38]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[39]  Dirk Van den Poel,et al.  Predicting customer retention and profitability by using random forests and regression forests techniques , 2005, Expert Syst. Appl..

[40]  J. Friedman.  Stochastic gradient boosting , 2002 .

[41]  Jesús M. Zamarreño,et al.  Prediction of hourly energy consumption in buildings based on a feedback artificial neural network , 2005 .

[42]  Ahmed Z. Al-Garni,et al.  Forecasting electric energy consumption using neural networks , 1995 .

[43]  Raúl Rojas,et al.  Neural Networks - A Systematic Introduction , 1996 .

[44]  Heng Huang,et al.  Using Smart Meter Data to Improve the Accuracy of Intraday Load Forecasting Considering Customer Behavior Similarities , 2015, IEEE Transactions on Smart Grid.

[45]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..