A Deep Learning and Gamification Approach to Energy Conservation at Nanyang Technological University

The implementation of smart building technology in the form of smart infrastructure applications has great potential to improve sustainability and energy efficiency by leveraging humans-in-the-loop strategy. However, human preference in regard to living conditions is usually unknown and heterogeneous in its manifestation as control inputs to a building. Furthermore, the occupants of a building typically lack the independent motivation necessary to contribute to and play a key role in the control of smart building infrastructure. Moreover, true human actions and their integration with sensing/actuation platforms remains unknown to the decision maker tasked with improving operational efficiency. By modeling user interaction as a sequential discrete game between non-cooperative players, we introduce a gamification approach for supporting user engagement and integration in a human-centric cyber-physical system. We propose the design and implementation of a large-scale network game with the goal of improving the energy efficiency of a building through the utilization of cutting-edge Internet of Things (IoT) sensors and cyber-physical systems sensing/actuation platforms. A benchmark utility learning framework that employs robust estimations for classical discrete choice models provided for the derived high dimensional imbalanced data. To improve forecasting performance, we extend the benchmark utility learning scheme by leveraging Deep Learning end-to-end training with Deep bi-directional Recurrent Neural Networks. We apply the proposed methods to high dimensional data from a social game experiment designed to encourage energy efficient behavior among smart building occupants in Nanyang Technological University (NTU) residential housing. Using occupant-retrieved actions for resources such as lighting and A/C, we simulate the game defined by the estimated utility functions.

[1]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[2]  J. Ang CO2 emissions, energy consumption, and output in France , 2007 .

[3]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[4]  Adriaan R. Soetevent,et al.  A discrete-choice model with social interactions: with an application to high school teen behavior , 2007 .

[5]  Ioannis C. Konstantakopoulos,et al.  Smart building energy efficiency via social game: a robust utility learning framework for closing–the–loop , 2016, 2016 1st International Workshop on Science of Smart City Operations and Platforms Engineering (SCOPE) in partnership with Global City Teams Challenge (GCTC) (SCOPE - GCTC).

[6]  Li-Rong Dai,et al.  A Regression Approach to Speech Enhancement Based on Deep Neural Networks , 2015, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[7]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[8]  Duncan S. Callaway,et al.  Using Residential Electric Loads for Fast Demand Response: The Potential Resource and Revenues, the Costs, and Policy Recommendations , 2012 .

[9]  Richard Block,et al.  WHERE OFFENDERS CHOOSE TO ATTACK: A DISCRETE CHOICE MODEL OF ROBBERIES IN CHICAGO* , 2009 .

[10]  Bo Li,et al.  Poisoning Attacks on Data-Driven Utility Learning in Games , 2018, 2018 Annual American Control Conference (ACC).

[11]  Erik Knol,et al.  EnerCities - A Serious Game to Stimulate Sustainability and Energy Conservation: Preliminary Results , 2011 .

[12]  Ming Jin,et al.  REST: a reliable estimation of stopping time algorithm for social game experiments , 2015, ICCPS.

[13]  Marco Jahn,et al.  Saving energy at work: the design of a pervasive game for office spaces , 2012, MUM.

[14]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[15]  Mohammed H. Albadi,et al.  A summary of demand response in electricity markets , 2008 .

[16]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[17]  MengChu Zhou,et al.  Social incentive policies to engage commercial building occupants in demand response , 2014, 2014 IEEE International Conference on Automation Science and Engineering (CASE).

[18]  Azucena Gracia,et al.  The demand for organic foods in the South of Italy: A discrete choice model , 2008 .

[19]  Honglak Lee,et al.  Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations , 2009, ICML '09.

[20]  Julian Padget,et al.  'just enough' sensing to ENLITEN: a preliminary demonstration of sensing strategy for the 'energy literacy through an intelligent home energy advisor' (ENLITEN) project , 2013, e-Energy '13.

[21]  Ben Cowley,et al.  Learning principles and interaction design for 'Green My Place': A massively multiplayer serious game , 2011, Entertain. Comput..

[22]  Ming Jin,et al.  Microgrid to enable optimal distributed energy retail and end-user demand response , 2018 .

[23]  Johanna L. Mathieu,et al.  Quantifying Changes in Building Electricity Use, With Application to Demand Response , 2011, IEEE Transactions on Smart Grid.

[24]  Yoshua Bengio,et al.  Show, Attend and Tell: Neural Image Caption Generation with Visual Attention , 2015, ICML.

[25]  Brian Orland,et al.  Saving energy in an office environment: A serious game intervention , 2014 .

[26]  Madeleine Gibescu,et al.  Deep learning for estimating building energy consumption , 2016 .

[27]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[28]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[29]  Ming Jin,et al.  Social game for building energy efficiency: Incentive design , 2014, 2014 52nd Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[30]  Alberto L. Sangiovanni-Vincentelli,et al.  Design Automation for Smart Building Systems , 2018, Proceedings of the IEEE.

[31]  Brantley Liddle,et al.  Revisiting Energy Consumption and GDP Causality: Importance of a Priori Hypothesis Testing, Disaggregated Data, and Heterogeneous Panels , 2015 .

[32]  Alex Graves,et al.  DRAW: A Recurrent Neural Network For Image Generation , 2015, ICML.

[33]  Fu Xiao,et al.  A short-term building cooling load prediction method using deep learning algorithms , 2017 .

[34]  Ming Jin,et al.  Inverse modeling of non-cooperative agents via mixture of utilities , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[35]  Florian Heiss,et al.  Discrete Choice Methods with Simulation , 2016 .

[36]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Chandra R. Bhat,et al.  A parameterized consideration set model for airport choice: an application to the San Francisco Bay Area , 2004 .

[38]  David E. Culler,et al.  Identifying models of HVAC systems using semiparametric regression , 2012, 2012 American Control Conference (ACC).

[39]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[40]  Ming Jin,et al.  A Robust Utility Learning Framework via Inverse Optimization , 2017, IEEE Transactions on Control Systems Technology.

[41]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[42]  B. Prabhakar,et al.  An Incentive Mechanism for Decongesting the Roads : A Pilot Program in Bangalore , 2009 .

[43]  J. Franklin,et al.  The elements of statistical learning: data mining, inference and prediction , 2005 .

[44]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[45]  Vanessa De Luca,et al.  The Social Power Game: A smart application for sharing energy-saving behaviours in the city. , 2014 .

[46]  Francesco Borrelli,et al.  A distributed predictive control approach to building temperature regulation , 2011, Proceedings of the 2011 American Control Conference.

[47]  A. Tversky,et al.  The framing of decisions and the psychology of choice. , 1981, Science.

[48]  Ming Jin,et al.  MOD-DR: Microgrid optimal dispatch with demand response , 2017 .

[49]  M. Boman,et al.  Energy Saving and Added Customer Value in Intelligent Buildings , 2007 .

[50]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[51]  S. Shankar Sastry,et al.  An inverse correlated equilibrium framework for utility learning in multiplayer, noncooperative settings , 2013, HiCoNS '13.

[52]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[53]  W S McCulloch,et al.  A logical calculus of the ideas immanent in nervous activity , 1990, The Philosophy of Artificial Intelligence.

[54]  Tariq Samad,et al.  Automated Demand Response for Smart Buildings and Microgrids: The State of the Practice and Research Challenges , 2016, Proceedings of the IEEE.

[55]  Ming Jin,et al.  Leveraging correlations in utility learning , 2017, 2017 American Control Conference (ACC).

[56]  S. Mitter,et al.  Dynamic Pricing and Stabilization of Supply and Demand in Modern Electric Power Grids , 2010, 2010 First IEEE International Conference on Smart Grid Communications.

[57]  George Kurian,et al.  Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation , 2016, ArXiv.

[58]  Milos Manic,et al.  Intelligent Buildings of the Future: Cyberaware, Deep Learning Powered, and Human Interacting , 2016, IEEE Industrial Electronics Magazine.

[59]  B. Prabhakar,et al.  INSINC: A Platform for Managing Peak Demand in Public Transit , 2013 .

[60]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[61]  Philip Chan,et al.  Toward accurate dynamic time warping in linear time and space , 2007, Intell. Data Anal..

[62]  Ming Jin,et al.  Social Game for Building Energy Efficiency: Utility Learning, Simulation, and Analysis , 2014, ArXiv.

[63]  Kenneth Train,et al.  A validation test of a disaggregate mode choice model , 1978 .

[64]  Daan Wierstra,et al.  Stochastic Backpropagation and Approximate Inference in Deep Generative Models , 2014, ICML.

[65]  Teresa Romão,et al.  A Gesture Interface Game for Energy Consumption Awareness , 2012, Advances in Computer Entertainment.

[66]  Dumitru Erhan,et al.  Deep Neural Networks for Object Detection , 2013, NIPS.

[67]  Samy Bengio,et al.  Show and tell: A neural image caption generator , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).