Augmenting building performance predictions during design using generative adversarial networks and immersive virtual environments

Abstract Existing building performance models (existing BPMs) often lack the capability for addressing human-building interactions in future buildings or buildings under design because they are mainly derived using data in existing buildings. The limitation may contribute to discrepancies between simulated and actual building performance. In a previous study, the authors discussed a framework using an artificial neural network (ANN)-based greedy algorithm which combines context-aware design-specific data obtained from immersive virtual environments (IVEs) with an existing BPM to enhance the simulations of human-building interactions in new designs. Although the framework has revealed the potential to improve simulations, it cannot determine the appropriate combination between context-aware design-specific data and the existing BPM. In this paper, the authors present a new computational framework (the GAN-based framework) to determine an appropriate combination based on a given performance target to achieve. Generative adversarial networks (GANs) are used to combine data of an existing BPM and context-aware design-specific data using a performance target as a guide to produce an augmented BPM. The effectiveness and the reliability of the GAN-based framework were validated using an IVE of a single occupancy office. Thirty people participated in an experiment on the simulation of artificial lighting switch uses using the IVE. Their light switch uses data under different work area illuminance were collected and analyzed. The building performance models (BPMs) proposed by Hunt and Da Silva were selected as the existing BPM and the performance target respectively. The data of each participant was used to generate an augmented BPM using the GAN-based framework and an updated BPM using the previous framework (i.e., ANN-based greedy algorithm framework). The thirty pairs of the augmented and updated BPMs were compared. Specifically, the errors measured between the updated BPMs and the performance target (E1) and the errors measured between the augmented BPMs and the performance target (E2) were analyzed using t-tests (α = 0.05). In 22 out of 30 cases, the performance of the augmented BPMs was significantly better than the updated BPMs, and in four cases, the performance of the two was similar. Only in four other cases, the performance of the updated BPMs was better. The results confirmed the efficacy of the framework. However, future research is needed to study the performance target and uncertainties associated with IVE experiments to better understand and control the reliability of the framework.

[1]  Chuang Wang,et al.  The evaluation of stochastic occupant behavior models from an application-oriented perspective: Using the lighting behavior model as a case study , 2018, Energy and Buildings.

[2]  Panagiotis Michalatos,et al.  LumiSpace: a VR architectural daylighting design system , 2016, SIGGRAPH ASIA Virtual Reality meets Physical Reality.

[3]  G. R. Newsham Manual Control of Window Blinds and Electric Lighting: Implications for Comfort and Energy Consumption , 1994 .

[4]  Christoph F. Reinhart,et al.  Lightswitch-2002: a model for manual and automated control of electric lighting and blinds , 2004 .

[5]  Supratik Mukhopadhyay,et al.  Progressively Growing Generative Adversarial Networks for High Resolution Semantic Segmentation of Satellite Images , 2018, 2018 IEEE International Conference on Data Mining Workshops (ICDMW).

[6]  D.R.G. Hunt,et al.  The use of artificial lighting in relation to daylight levels and occupancy , 1979 .

[7]  Saleh A. Alshebeili,et al.  A Monte Carlo simulation for two novel automatic censoring techniques of radar interfering targets in log-normal clutter , 2008, Signal Process..

[8]  Supratik Mukhopadhyay,et al.  Improving Prediction Accuracy in Building Performance Models Using Generative Adversarial Networks (GANs) , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[9]  Peter Boyce,et al.  Lighting research for interiors: the beginning of the end or the end of the beginning , 2004 .

[10]  Christoph F. Reinhart,et al.  Adding advanced behavioural models in whole building energy simulation: A study on the total energy impact of manual and automated lighting control , 2006 .

[11]  Supratik Mukhopadhyay,et al.  DeepSat: a learning framework for satellite imagery , 2015, SIGSPATIAL/GIS.

[12]  Burcin Becerik-Gerber,et al.  Immersive virtual environments, understanding the impact of design features and occupant choice upon lighting for building performance , 2015 .

[13]  R. Likert “Technique for the Measurement of Attitudes, A” , 2022, The SAGE Encyclopedia of Research Design.

[14]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[15]  John F. Sowa,et al.  Syntax, Semantics, and Pragmatics of Contexts , 1995, ICCS.

[16]  Catalina Spataru,et al.  A Review of the Regulatory Energy Performance Gap and Its Underlying Causes in Non-domestic Buildings , 2016, Front. Mech. Eng..

[17]  Supratik Mukhopadhyay,et al.  CactusNets: Layer Applicability as a Metric for Transfer Learning , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[18]  Christoph F. Reinhart,et al.  Monitoring manual control of electric lighting and blinds , 2003 .

[19]  Jost Tobias Springenberg,et al.  Unsupervised and Semi-supervised Learning with Categorical Generative Adversarial Networks , 2015, ICLR.

[20]  Bjarne W. Olesen,et al.  Occupants' window opening behaviour: A literature review of factors influencing occupant behaviour and models , 2012 .

[21]  Supratik Mukhopadhyay,et al.  Deep neural networks for texture classification - A theoretical analysis , 2018, Neural Networks.

[22]  Bernard Marie Lachal,et al.  Predicted versus observed heat consumption of a low energy multifamily complex in Switzerland based on long-term experimental data , 2004 .

[23]  Pádraig Cunningham,et al.  Stability problems with artificial neural networks and the ensemble solution , 2000, Artif. Intell. Medicine.

[24]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[25]  Dirk P. Kroese,et al.  Why the Monte Carlo method is so important today , 2014 .

[26]  Supratik Mukhopadhyay,et al.  Improving Route Choice Models by Incorporating Contextual Factors via Knowledge Distillation , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[27]  Amirhosein Jafari,et al.  Applying the Gaussian Mixture Model to Generate Large Synthetic Data from a Small Data Set , 2020 .

[28]  Caroline M. Clevenger,et al.  Demonstrating the Impact of the Occupant on Building Performance , 2014, J. Comput. Civ. Eng..

[29]  Supratik Mukhopadhyay,et al.  Unsupervised Learning using Pretrained CNN and Associative Memory Bank , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[30]  E. Kreyszig,et al.  Advanced Engineering Mathematics. , 1974 .

[31]  Vítor Leal,et al.  Occupants interaction with electric lighting and shading systems in real single-occupied offices: Results from a monitoring campaign , 2013 .

[32]  Ira Helsloot,et al.  First International Conference on Evacuation Modelling and Management Exit choice, (pre-)movement time and (pre-)evacuation behaviour in hotel fire evacuation - Behavioural analysis and validation of the use of serious gaming in experimental research , 2010 .

[33]  Sungkwon Woo,et al.  Building Information Modeling (BIM)-Based Design of Energy Efficient Buildings , 2011 .

[34]  Supratik Mukhopadhyay,et al.  Why do you take that route? , 2019, CogSci.

[35]  Ardeshir Mahdavi,et al.  An inquiry into the reliability of window operation models in building performance simulation , 2016 .

[36]  Glen Takahara,et al.  Independent and Identically Distributed Monte Carlo Algorithms for Semiparametric Linear Mixed Models , 2002 .

[37]  Yimin Zhu,et al.  Measuring the Effectiveness of an Immersive Virtual Environment for the Modeling and Prediction of Occupant Behavior , 2015 .

[38]  Peter Boyce,et al.  Individual Lighting Control: Task Performance, Mood, and Illuminance , 2000 .

[39]  Jeremy C. Brooks,et al.  Virtual Reality Cue Reactivity Assessment in Cigarette Smokers , 2005, Cyberpsychology Behav. Soc. Netw..

[40]  Patrick T.I. Lam,et al.  Optimising design objectives using the Balanced Scorecard approach , 2009 .

[41]  Supratik Mukhopadhyay,et al.  Enhancing the Prediction of Artificial Lighting Control Behavior Using Virtual Reality (VR): A Pilot Study , 2018 .

[42]  Supratik Mukhopadhyay,et al.  A One-Shot Learning Framework for Assessment of Fibrillar Collagen from Second Harmonic Generation Images of an Infarcted Myocardium , 2020, 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI).

[43]  Sanaz Saeidi,et al.  Spatial-temporal event-driven modeling for occupant behavior studies using immersive virtual environments , 2018, Automation in Construction.

[44]  K. Steemers,et al.  Time-dependent occupant behaviour models of window control in summer , 2008 .

[45]  Tito Homem-de-Mello,et al.  On Rates of Convergence for Stochastic Optimization Problems Under Non--Independent and Identically Distributed Sampling , 2008, SIAM J. Optim..

[46]  D.R.G. Hunt,et al.  Predicting artificial lighting use - a method based upon observed patterns of behaviour , 1980 .

[47]  Supratik Mukhopadhyay,et al.  PCGAN-CHAR: Progressively Trained Classifier Generative Adversarial Networks for Classification of Noisy Handwritten Bangla Characters , 2019, ICADL.

[48]  Simon Osindero,et al.  Conditional Generative Adversarial Nets , 2014, ArXiv.

[49]  Guy R. Newsham,et al.  Lighting quality and energy-efficiency effects on task performance , 1998 .

[50]  Tianzhen Hong,et al.  An ontology to represent energy-related occupant behavior in buildings. Part I: Introduction to the DNAs framework , 2015 .

[51]  H. Rijal Investigation of Comfort Temperature and Occupant Behavior in Japanese Houses during the Hot and Humid Season , 2014 .

[52]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[53]  Supratik Mukhopadhyay,et al.  Combining context-aware design-specific data and building performance models to improve building performance predictions during design , 2019, Automation in Construction.

[54]  B. Thomas,et al.  The efficacy of playing a virtual reality game in modulating pain for children with acute burn injuries: A randomized controlled trial [ISRCTN87413556] , 2005, BMC pediatrics.

[55]  Sanyuan Niu,et al.  A virtual reality integrated design approach to improving occupancy information integrity for closing the building energy performance gap , 2016 .

[56]  Nilesh R. Patel,et al.  Implementation and Comparison of Speech Emotion Recognition System Using Gaussian Mixture Model (GMM) and K- Nearest Neighbor (K-NN) Techniques , 2015 .

[57]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[58]  Dimitrios Gyalistras,et al.  Performance gaps in Swiss buildings: an analysis of conflicting objectives and mitigation strategies , 2017 .

[59]  Robert DiBiano,et al.  A machine learning algorithm to improve building performance modeling during design , 2019, MethodsX.

[60]  Karsten Menzel,et al.  Integrating the Specification, Acquisition and Processing of Building Performance Information , 2008 .

[61]  Ramsés H. Mena,et al.  Controlling the reinforcement in Bayesian non‐parametric mixture models , 2007 .

[62]  Ki Yong Lee Local fuzzy PCA based GMM with dimension reduction on speaker identification , 2004, Pattern Recognit. Lett..

[63]  Max Kinateder,et al.  Social influence in a virtual tunnel fire--influence of conflicting information on evacuation behavior. , 2014, Applied ergonomics.

[64]  Geoffrey Stewart Morrison,et al.  A comparison of procedures for the calculation of forensic likelihood ratios from acoustic-phonetic data: Multivariate kernel density (MVKD) versus Gaussian mixture model-universal background model (GMM-UBM) , 2011, Speech Commun..

[65]  Zhiqiang Wang,et al.  Comparison of K-means and GMM methods for contextual clustering in HSM , 2019, Procedia Manufacturing.

[66]  Ian Beausoleil-Morrison,et al.  Development and implementation of an adaptive lighting and blinds control algorithm , 2017 .

[67]  Astrid Roetzel,et al.  Potential and challenges of immersive virtual environments for occupant energy behavior modeling and validation: A literature review , 2018, Journal of Building Engineering.

[68]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.