Automated data-driven modeling of building energy systems via machine learning algorithms

Abstract System modeling is a vital part of building energy optimization and control. Grey and white box modeling requires knowledge about the system and a lot of human assistance, which results in costs. In the common case, that information about the system is lacking, the feasibility of grey and white box models decreases further. The installation of sensors and the availability of monitoring data is growing rapidly within building energy systems. This enables the exploitation of statistical modeling, which is already well established in other sectors like computer science and finance. Thus, the present work investigates data-driven machine learning models to explore their potential for modeling building energy systems. The focus is to develop an efficient methodology for data-driven modeling. For this purpose, a comprehensive literature review for detecting optimization methods is conducted. Furthermore, the methodology is implemented in Python and an automated modeling tool is designed. It is used to model various energy systems based on monitoring data; seven use cases on three different systems reveal good results. The models can be used for forecasting, potential analysis, the implementation of various control strategies or as a replacement for missing information within the field of grey box modeling.

[1]  Nikola Bogunovic,et al.  A review of feature selection methods with applications , 2015, 2015 38th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO).

[2]  Marko Robnik-Sikonja,et al.  Theoretical and Empirical Analysis of ReliefF and RReliefF , 2003, Machine Learning.

[3]  Chris Chatfield,et al.  Model uncertainty and forecast accuracy , 1996 .

[4]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[5]  Mohammad Yusri Hassan,et al.  A review on applications of ANN and SVM for building electrical energy consumption forecasting , 2014 .

[6]  Jiejin Cai,et al.  Applying support vector machine to predict hourly cooling load in the building , 2009 .

[7]  Syed Imran Ali.  A Feature Subset Selection Method based on Conditional Mutual Information and Ant Colony Optimization , 2012 .

[8]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[9]  Jan Pieters,et al.  Modelling Greenhouse Temperature by means of Auto Regressive Models , 2003 .

[10]  Michael Y. Hu,et al.  Forecasting with artificial neural networks: The state of the art , 1997 .

[11]  Julio Ariel Romero,et al.  A simplified black-box model oriented to chilled water temperature control in a variable speed vapour compression system , 2011 .

[12]  Wes McKinney,et al.  Data Structures for Statistical Computing in Python , 2010, SciPy.

[13]  John D. Hunter,et al.  Matplotlib: A 2D Graphics Environment , 2007, Computing in Science & Engineering.

[14]  Jiahui Wang,et al.  Modeling Financial Time Series with S-PLUS® , 2003 .

[15]  Qi Miao,et al.  Nonlinear model predictive control based on support vector regression , 2002, Proceedings. International Conference on Machine Learning and Cybernetics.

[16]  Aaron Klein,et al.  Efficient and Robust Automated Machine Learning , 2015, NIPS.

[17]  J. Larsen,et al.  Design and regularization of neural networks: the optimal use of a validation set , 1996, Neural Networks for Signal Processing VI. Proceedings of the 1996 IEEE Signal Processing Society Workshop.

[18]  Volker Roth,et al.  The generalized LASSO , 2004, IEEE Transactions on Neural Networks.

[19]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[20]  Nelson Fumo,et al.  A review on the basics of building energy estimation , 2014 .

[21]  Andreas W. Kempa-Liehr,et al.  Time Series FeatuRe Extraction on basis of Scalable Hypothesis tests (tsfresh - A Python package) , 2018, Neurocomputing.

[22]  Miriam A. M. Capretz,et al.  Energy Forecasting for Event Venues: Big Data and Prediction Accuracy , 2016 .

[23]  Sylvain Robert,et al.  State of the art in building modelling and energy performances prediction: A review , 2013 .

[24]  Chika O. Nwankpa,et al.  Physically-Based Building Load Model for Electric Grid Operation and Planning , 2017, IEEE Transactions on Smart Grid.

[25]  M. Carmen Garrido,et al.  Feature subset selection Filter-Wrapper based on low quality data , 2013, Expert Syst. Appl..

[26]  Saguna Saguna,et al.  Applied machine learning: Forecasting heat load in district heating system , 2016 .

[27]  Serdar Iplikci,et al.  Support vector machines‐based generalized predictive control , 2006 .

[28]  David D. Cox,et al.  Making a Science of Model Search: Hyperparameter Optimization in Hundreds of Dimensions for Vision Architectures , 2013, ICML.

[29]  Sayan Mukherjee,et al.  Choosing Multiple Parameters for Support Vector Machines , 2002, Machine Learning.

[30]  Concha Bielza,et al.  A survey on multi‐output regression , 2015, WIREs Data Mining Knowl. Discov..

[31]  Coskun Hamzaçebi,et al.  Improving artificial neural networks' performance in seasonal time series forecasting , 2008, Inf. Sci..

[32]  Jasper Snoek,et al.  Practical Bayesian Optimization of Machine Learning Algorithms , 2012, NIPS.

[33]  Gilles Lefebvre,et al.  Using model size reduction techniques for thermal control applications in buildings , 2000 .

[34]  Filip De Turck,et al.  Evolutionary Model Type Selection for Global Surrogate Modeling , 2009, J. Mach. Learn. Res..

[35]  Farrokh Janabi-Sharifi,et al.  Black-box modeling of residential HVAC system and comparison of gray-box and black-box modeling methods , 2015 .

[36]  Jian Chu,et al.  Forecasting building energy consumption using neural networks and hybrid neuro-fuzzy system: A compa , 2011 .

[37]  Jin Wen,et al.  Review of building energy modeling for control and operation , 2014 .

[38]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[39]  Lynne E. Parker,et al.  Energy and Buildings , 2012 .

[40]  David H. Wolpert,et al.  The Lack of A Priori Distinctions Between Learning Algorithms , 1996, Neural Computation.

[41]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[42]  R. Sarker,et al.  Artificial Neural Networks in Finance and Manufacturing , 2006 .

[43]  Yacine Rezgui,et al.  Trees vs Neurons: Comparison between random forest and ANN for high-resolution prediction of building energy consumption , 2017 .

[44]  Francis Eng Hock Tay,et al.  Support vector machine with adaptive parameters in financial time series forecasting , 2003, IEEE Trans. Neural Networks.

[45]  Gaël Varoquaux,et al.  The NumPy Array: A Structure for Efficient Numerical Computation , 2011, Computing in Science & Engineering.

[46]  Kevin Leyton-Brown,et al.  Sequential Model-Based Optimization for General Algorithm Configuration , 2011, LION.

[47]  R. K. Agrawal,et al.  An Introductory Study on Time Series Modeling and Forecasting , 2013, ArXiv.

[48]  Aun-Neow Poo,et al.  Support vector regression model predictive control on a HVAC plant , 2007 .

[49]  Piet Demeester,et al.  A Surrogate Modeling and Adaptive Sampling Toolbox for Computer Based Design , 2010, J. Mach. Learn. Res..

[50]  Guoqiang Peter Zhang,et al.  Time series forecasting using a hybrid ARIMA and neural network model , 2003, Neurocomputing.

[51]  Aurélien Géron,et al.  Hands-On Machine Learning with Scikit-Learn and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems , 2017 .

[52]  Radiša Jovanović,et al.  Ensemble of various neural networks for prediction of heating energy consumption , 2015 .

[53]  Lars Kotthoff,et al.  Auto-WEKA 2.0: Automatic model selection and hyperparameter optimization in WEKA , 2017, J. Mach. Learn. Res..

[54]  Andrew Kusiak,et al.  Modeling and optimization of HVAC energy consumption , 2010 .

[55]  Ruben Martinez-Cantin,et al.  BayesOpt: a Bayesian optimization library for nonlinear optimization, experimental design and bandits , 2014, J. Mach. Learn. Res..