Technological innovations to assess and include the human dimension in the building-performance loop: A review

Abstract The human dimension plays an essential role in the energy performance of buildings and is considered as significant as technological advances. Several studies highlighted the negative influence of occupant behaviour in underperforming buildings, while some support that technological innovations may reduce human-related uncertainties. Thus, one may consider that fully automated smart buildings are essential to achieve energy efficiency. However, if technology excludes people from decision-making processes, low acceptance and comfort/welfare levels may be reported from users. Therefore, the right combination of humans and technologies are expected to solve these problems. Buildings are emerging as complex Cyber-Physical Systems, including the Social dimension, and this provides an excellent opportunity to achieve high-performance outcomes, considering both technical and social aspects. Thus, the right choice among available up-to-date behavioural sensing – comprising active and passive sensors, as well as Kinect technology – are important in the Internet-of-Things (IoT) era. IoT-driven buildings can use real-time monitoring data to inform users and drive behavioural-based consumption change, which is an important aspect to achieve high-performance buildings and deliver user-centred services. An essential feature in this regard is to allow for human-in-the-loop approaches enabled by human-centric computing and smart devices, which has grown fast in the last few years. This literature review summarises applications and main challenges related to the combination of the human dimension and technological innovations in the building sector. This combination is expected to increase user welfare and reduce the energy consumption in buildings, as human and machine components of intelligence may complement each other regarding building performance.

[1]  Haili Liu,et al.  A Novel Chopped Pyroelectric Infrared Sensor for Detecting the Presence of Stationary and Moving Occupants , 2017 .

[2]  Burcin Becerik-Gerber,et al.  Towards Understanding End-user Lighting Preferences in Office Spaces by Using Immersive Virtual Environments , 2015 .

[3]  Hongshan Guo,et al.  Impact of Control Availability on Perceived Comfort , 2015 .

[4]  Ramón F. Brena,et al.  Infrastructure-Less Indoor Localization Using the Microphone, Magnetometer and Light Sensor of a Smartphone , 2015, Sensors.

[5]  Eser Kandogan,et al.  Towards a Unified Representation of Insight in Human-in-the-Loop Analytics: A User Study , 2018, HILDA@SIGMOD.

[6]  John Lygeros,et al.  Humans-in-the-loop: A Game-Theoretic Perspective on Adaptive Building Energy Systems , 2018, 2018 European Control Conference (ECC).

[7]  Silvia Conforto,et al.  Wearable PVDF transducer for biomechanical energy harvesting and gait cycle detection , 2016, 2016 IEEE EMBS Conference on Biomedical Engineering and Sciences (IECBES).

[8]  Martin Masek,et al.  A Novel Fuzzy Based Home Occupant Monitoring System Using Kinect Cameras , 2015, 2015 IEEE 27th International Conference on Tools with Artificial Intelligence (ICTAI).

[9]  Mani B. Srivastava,et al.  SensorAct: A Decentralized and Scriptable Middleware for Smart Energy Buildings , 2015, 2015 IEEE 12th Intl Conf on Ubiquitous Intelligence and Computing and 2015 IEEE 12th Intl Conf on Autonomic and Trusted Computing and 2015 IEEE 15th Intl Conf on Scalable Computing and Communications and Its Associated Workshops (UIC-ATC-ScalCom).

[10]  Alexander V. Smirnov,et al.  Multi-level Self-organization in Cyber-Physical-Social Systems: Smart Home Cleaning Scenario☆ , 2015 .

[11]  Khamla Non-Alisavath,et al.  Context-awareness application to control multiple sensors for monitoring smart environment , 2017, 2017 14th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON).

[13]  M. A. Iqbal,et al.  Smart home appliance control system for physically disabled people using kinect and X10 , 2016, 2016 5th International Conference on Informatics, Electronics and Vision (ICIEV).

[14]  P. Cipresso,et al.  Back to the Future of Quantitative Psychology and Measurement: Psychometrics in the Twenty-First Century , 2017, Front. Psychol..

[15]  S. Boulmrharj,et al.  Towards a context-driven platform using IoT and big data technologies for energy efficient buildings , 2017, 2017 3rd International Conference of Cloud Computing Technologies and Applications (CloudTech).

[16]  Fadi M. Alsaleem,et al.  Sensitivity study for the PMV thermal comfort model and the use of wearable devices biometric data for metabolic rate estimation , 2016 .

[17]  Alejandro R. Diaz,et al.  Modal disparity and its experimental verification , 2008 .

[18]  Jean Hennebert,et al.  Near Real-Time Appliance Recognition Using Low Frequency Monitoring and Active Learning Methods , 2017 .

[19]  Feng Gao,et al.  Butler, Not Servant: A Human-Centric Smart Home Energy Management System , 2017, IEEE Communications Magazine.

[20]  AnHai Doan,et al.  Human-in-the-Loop Data Analysis: A Personal Perspective , 2018, HILDA@SIGMOD.

[21]  Dimitrios Tzovaras,et al.  A Human-Centric & Context-Aware IoT Framework for Enhancing Energy Efficiency in Buildings of Public Use , 2018, IEEE Access.

[22]  Arjan Kuijper,et al.  Performing indoor localization with electric potential sensing , 2018, J. Ambient Intell. Humaniz. Comput..

[23]  José Barata,et al.  Collaborative Data Mining for Intelligent Home Appliances , 2016, PRO-VE.

[24]  Mahmood F. Mosleh,et al.  IMPLEMENTATION OF ACTIVE WIRELESS SENSOR NETWORK MONITORING USING ZIGBEE PROTOCOL , 2017 .

[25]  Nickson M. Karie,et al.  Adding Digital Forensic Readiness as a Security Component to the IoT Domain , 2018 .

[26]  Yimin Liu,et al.  Micro Hand Gesture Recognition System Using Ultrasonic Active Sensing , 2017, IEEE Access.

[27]  Andreas Jacobsson,et al.  A risk analysis of a smart home automation system , 2016, Future Gener. Comput. Syst..

[28]  Amandine Dubois,et al.  Person identification from gait analysis with a depth camera at home , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[29]  Bo Tan,et al.  Passive Radar for Opportunistic Monitoring in E-Health Applications , 2018, IEEE Journal of Translational Engineering in Health and Medicine.

[30]  Toshifumi Tsukiyama,et al.  In-home Health Monitoring System for Solitary Elderly , 2015, EUSPN/ICTH.

[31]  Yacine Rezgui,et al.  Progress in ambient assisted systems for independent living by the elderly , 2016, SpringerPlus.

[32]  Eleni Stroulia,et al.  Indoor Localization: A Cost-Effectiveness vs. Accuracy Study , 2017, 2017 IEEE 30th International Symposium on Computer-Based Medical Systems (CBMS).

[33]  B. B. Zaidan,et al.  A review of smart home applications based on Internet of Things , 2017, J. Netw. Comput. Appl..

[34]  Giuseppe Iannaccone,et al.  Low-Power Wearable ECG Monitoring System for Multiple-Patient Remote Monitoring , 2016, IEEE Sensors Journal.

[35]  G. Boy From Rigid to Flexible – From Virtual to Tangible an Evolution of Human-Centered Design , 2018, Advances in Intelligent Systems and Computing.

[36]  Tianzhen Hong,et al.  A data-mining approach to discover patterns of window opening and closing behavior in offices , 2014 .

[37]  Srinivas Katkoori,et al.  Design and implementation of an embedded system for monitoring at-home solitary Alzheimer's patients , 2015, 2015 IEEE 58th International Midwest Symposium on Circuits and Systems (MWSCAS).

[38]  Hao Jiang,et al.  Device-Free Occupant Activity Sensing Using WiFi-Enabled IoT Devices for Smart Homes , 2018, IEEE Internet of Things Journal.

[39]  Yan Da,et al.  Indoor occupant behaviour monitoring with the use of a depth registration camera , 2019, Building and Environment.

[40]  Mikhail Komarov,et al.  How Internet of Things Influences Human Behavior Building Social Web of Services via Agent-Based Approach , 2016 .

[41]  Ing-Jr Ding,et al.  Three-layered hierarchical scheme with a Kinect sensor microphone array for audio-based human behavior recognition , 2016, Comput. Electr. Eng..

[42]  Changmin Lee,et al.  Occupancy-based adaptive dimmable lighting energy management scheme combined with cyber physical system , 2018, 2018 International Conference on Information Networking (ICOIN).

[43]  Manish Gupta,et al.  User Presence Estimation in Multi-Occupancy Rooms Using Plug-Load Meters and PIR Sensors , 2017, GLOBECOM 2017 - 2017 IEEE Global Communications Conference.

[44]  Nirmalya Roy,et al.  RAM: Radar-based activity monitor , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[45]  George Kachergis,et al.  The Other Human in The Loop – A Pilot Study to Find Selection Strategies for Active Learning , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[46]  Masatoshi Ishikawa,et al.  Tracking and recognition of a human hand in dynamic motion for Janken (rock-paper-scissors) robot , 2016, 2016 IEEE International Conference on Automation Science and Engineering (CASE).

[47]  Antonio F. Gómez-Skarmeta,et al.  Providing Personalized Energy Management and Awareness Services for Energy Efficiency in Smart Buildings , 2017, Sensors.

[48]  S. I. A. P. Diddeniya,et al.  Voice operated home automation system based on Kinect sensor , 2016, 2016 IEEE International Conference on Information and Automation for Sustainability (ICIAfS).

[49]  Chee Pin Tan,et al.  Smart lighting: The way forward? Reviewing the past to shape the future , 2017 .

[50]  M. Shamim Hossain,et al.  Green Cognitive Body Sensor Network: Architecture, Energy Harvesting, and Smart Clothing-Based Applications , 2019, IEEE Sensors Journal.

[51]  Jinyoung Han,et al.  Comprehensive Approaches to User Acceptance of Internet of Things in a Smart Home Environment , 2017, IEEE Internet of Things Journal.

[52]  Bruce Christianson,et al.  Guarantor and reputation based trust model for Social Internet of Things , 2015, 2015 International Wireless Communications and Mobile Computing Conference (IWCMC).

[53]  Tianzhen Hong,et al.  Ten questions concerning occupant behavior in buildings: The big picture , 2017 .

[54]  Andreas Seitz,et al.  A fog architecture for decentralized decision making in smart buildings , 2017, SCOPE@CPSWeek.

[55]  Xiaohui Peng,et al.  Deep Learning for Sensor-based Activity Recognition: A Survey , 2017, Pattern Recognit. Lett..

[56]  Hiroshi Yoshino,et al.  IEA EBC annex 53: Total energy use in buildings—Analysis and evaluation methods , 2017 .

[57]  Sanyuan Niu,et al.  A virtual reality integrated design approach to improving occupancy information integrity for closing the building energy performance gap , 2016 .

[58]  Burcin Becerik-Gerber,et al.  Buildings with persona: Towards effective building-occupant communication , 2017, Comput. Hum. Behav..

[59]  Julio J. Valdés,et al.  Testing the accuracy of low-cost data streams for determining single-person office occupancy and their use for energy reduction of building services , 2017 .

[60]  Rin-ichiro Taniguchi,et al.  Power Demand Forecasting Using Meteorological Data and Human Congestion Information , 2016, 2016 IEEE 4th International Conference on Cyber-Physical Systems, Networks, and Applications (CPSNA).

[61]  Burcin Becerik-Gerber,et al.  Lights, building, action: Impact of default lighting settings on occupant behaviour , 2016 .

[62]  Robert J. Piechocki,et al.  Wi-Fi based passive human motion sensing for in-home healthcare applications , 2015, 2015 IEEE 2nd World Forum on Internet of Things (WF-IoT).

[63]  Marjorie Skubic,et al.  Automated Health Alerts Using In-Home Sensor Data for Embedded Health Assessment , 2015, IEEE Journal of Translational Engineering in Health and Medicine.

[64]  Mikkel Baun Kjærgaard,et al.  Metafier — A tool for annotating and structuring building metadata , 2017, 2017 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computed, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI).

[65]  Nacer Abouchi,et al.  Detection of collaborative activity with Kinect depth cameras , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[66]  Theodora Varvarigou,et al.  Smart heating in collaborative and reasoning-enabled housing units , 2020, Future Gener. Comput. Syst..

[67]  Lillykutty Jacob,et al.  An Occupancy Based Cyber-Physical System Design for Intelligent Building Automation , 2015 .

[68]  Prashant Kumar,et al.  Indoor air quality and energy management through real-time sensing in commercial buildings , 2016 .

[69]  Dan Yang,et al.  Passive Infrared (PIR)-Based Indoor Position Tracking for Smart Homes Using Accessibility Maps and A-Star Algorithm , 2018, Sensors.

[70]  Hirozumi Yamaguchi,et al.  Human crowd detection for physical sensing assisted geo-social multimedia mining , 2015, 2015 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[71]  Adam T Wagler,et al.  Comparing Virtual Reality Tourism to Real-Life Experience: Effects of Presence and Engagement on Attitude and Enjoyment , 2018, Communication Research Reports.

[72]  Srinivasan Seshan,et al.  Active sensing data collection with autonomous mobile robots , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[73]  Junwen Zhong,et al.  Sensitivity-Enhanced Wearable Active Voiceprint Sensor Based on Cellular Polypropylene Piezoelectret. , 2017, ACS applied materials & interfaces.

[74]  Francesca Stazi,et al.  Measuring Occupants' Behaviour for Buildings' Dynamic Cosimulation , 2018, J. Sensors.

[75]  Irina Trendafilova,et al.  Triboelectric nanogenerator as self-powered impact sensor , 2018 .

[76]  Mglc Marcel Loomans,et al.  Personal control over indoor climate and productivity , 2014 .

[77]  Anthony Rowe,et al.  Occupancy estimation using ultrasonic chirps , 2015, ICCPS.

[78]  Pong C. Yuen,et al.  Improving posture classification accuracy for depth sensor-based human activity monitoring in smart environments , 2016, Comput. Vis. Image Underst..

[79]  Christopher B. Mayhorn,et al.  Signage Versus Environmental Affordances: Is the Explicit Information Strong Enough to Guide Human Behavior During a Wayfinding Task? , 2015 .

[80]  Bhautik Pipaliya,et al.  Modelling human behaviour in smart home energy management systems via machine learning techniques , 2016, 2016 International Automatic Control Conference (CACS).

[81]  Theis Heidmann Pedersen,et al.  Establishing an image-based ground truth for validation of sensor data-based room occupancy detection , 2016 .

[82]  Sajal Kanta Das,et al.  IoT based smart home management to enhance the services to the occupancies and minimized energy demand by controlling appliances using wireless motes , 2017, 2017 International conference on Microelectronic Devices, Circuits and Systems (ICMDCS).

[83]  Elie Azar,et al.  Integrating building performance simulation in agent-based modeling using regression surrogate models: A novel human-in-the-loop energy modeling approach , 2016 .

[84]  Akio Namiki,et al.  Efficient Active Sensing with Categorized Further Explorations for a Home Behavior-Monitoring Robot , 2017, Journal of healthcare engineering.

[85]  Vladimir Tanasiev,et al.  IoT for Smart Residential Buildings , 2018, 2018 IEEE International Conference on Environment and Electrical Engineering and 2018 IEEE Industrial and Commercial Power Systems Europe (EEEIC / I&CPS Europe).

[86]  Costas J. Spanos,et al.  A deep learning and gamification approach to improving human-building interaction and energy efficiency in smart infrastructure , 2019, Applied Energy.

[87]  Tuan Anh Nguyen,et al.  Energy intelligent buildings based on user activity: A survey , 2013 .

[88]  Kyandoghere Kyamakya,et al.  Activity Recognition in Sensor Data Streams for Active and Assisted Living Environments , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[89]  Costas J. Spanos,et al.  Towards a theory of free-lunch privacy in cyber-physical systems , 2017, 2017 55th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[90]  Ioannis Chatzigiannakis,et al.  On Mining IoT Data for Evaluating the Operation of Public Educational Buildings , 2018, 2018 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops).

[91]  Weihua Sheng,et al.  Human-guided robot 3D mapping using virtual reality technology , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[92]  Astrid Roetzel,et al.  Potential and challenges of immersive virtual environments for occupant energy behavior modeling and validation: A literature review , 2018, Journal of Building Engineering.

[93]  Paula Trigueiros,et al.  Automatic meal intake monitoring using Hidden Markov Models , 2016 .

[94]  Tianzhen Hong,et al.  The human dimensions of energy use in buildings: A review , 2018 .

[95]  Antonio F. Skarmeta,et al.  An indoor localization system based on 3D magnetic fingerprints for smart buildings , 2015, The 2015 IEEE RIVF International Conference on Computing & Communication Technologies - Research, Innovation, and Vision for Future (RIVF).

[96]  Tianzhen Hong,et al.  An ontology to represent energy-related occupant behavior in buildings. Part I: Introduction to the DNAs framework , 2015 .

[97]  Henriette Bier,et al.  Adaptive building-skin components as context-aware nodes in an extended cyber-physical network , 2016, 2016 IEEE 3rd World Forum on Internet of Things (WF-IoT).

[98]  Zosia Brown,et al.  Reconciling human and automated intelligence in the provision of occupant comfort , 2009 .

[99]  Yongning He,et al.  Theoretical Study of Triboelectric-Potential Gated/Driven Metal-Oxide-Semiconductor Field-Effect Transistor. , 2016, ACS nano.

[100]  Theodore B. Zahariadis,et al.  Addressing behavioral change towards energy efficiency in European educational buildings , 2017, 2017 Global Internet of Things Summit (GIoTS).

[101]  Hirohiko Suwa,et al.  Kinect-Based Micro-Behavior Sensing System for Learning the Smart Assistance with Human Subjects Inside Their Homes , 2018, 2018 Workshop on Metrology for Industry 4.0 and IoT.

[102]  Jácome Cunha,et al.  A Building Automation Case Study Setup and Challenges , 2018, 2018 IEEE/ACM 4th International Workshop on Software Engineering for Smart Cyber-Physical Systems (SEsCPS).

[103]  Tobias Nef,et al.  Evaluation of Three State-of-the-Art Classifiers for Recognition of Activities of Daily Living from Smart Home Ambient Data , 2012, Sensors.

[104]  P Pieter-Jan Hoes,et al.  Occupant behavior in building energy simulation: towards a fit-for-purpose modeling strategy , 2016 .

[105]  Zhu Wang,et al.  Mobile Crowd Sensing and Computing , 2015, ACM Comput. Surv..

[106]  Kehua Guo,et al.  Relevant Feedback Based Accurate and Intelligent Retrieval on Capturing User Intention for Personalized Websites , 2018, IEEE Access.

[107]  Ching-Hu Lu IoT-Enabled Adaptive Context-Aware and Playful Cyber-Physical System for Everyday Energy Savings , 2018, IEEE Transactions on Human-Machine Systems.

[108]  Pooja A. Dhobi,et al.  IoT based home appliances control , 2017, 2017 International Conference on Computing Methodologies and Communication (ICCMC).

[109]  T. Tantidham,et al.  HIVE: Home Automation System for Intrusion Detection , 2016, 2016 Fifth ICT International Student Project Conference (ICT-ISPC).

[110]  Sunil Kumar,et al.  Web objects based energy efficiency for smart home IoT service provisioning , 2017, 2017 Ninth International Conference on Ubiquitous and Future Networks (ICUFN).

[111]  Giuseppina Gini,et al.  From learning to new goal generation in a bioinspired robotic setup , 2016, Adv. Robotics.

[112]  Ravi S. Srinivasan,et al.  From occupancy to occupant behavior: An analytical survey of data acquisition technologies, modeling methodologies and simulation coupling mechanisms for building energy efficiency , 2017 .

[113]  Elias B. Kosmatopoulos,et al.  Adaptive optimization for smart operation of cyber-physical systems: A thermostatic zoning test case , 2017, 2017 13th IEEE International Conference on Control & Automation (ICCA).

[114]  Fahim Kawsar,et al.  Tiny habits in the giant enterprise: understanding the dynamics of a quantified workplace , 2015, UbiComp.

[115]  Hiroyuki Morikawa,et al.  Active sensing approach to electrical load classification by smart plug , 2017, 2017 IEEE Power & Energy Society Innovative Smart Grid Technologies Conference (ISGT).

[116]  Frédéric Wurtz,et al.  “Smart buildings” integrated in “smart grids”: A key challenge for the energy transition by using physical models and optimization with a “human-in-the-loop” approach , 2017 .

[117]  Mehdi Mortazavi,et al.  A new approach in system and tactic design optimization of an autonomous underwater vehicle by using Multidisciplinary Design Optimization , 2018 .

[118]  Yuren Zhou,et al.  IoT Based Experimental Study to Modify Water Consumption Behavior of Domestic Users , 2018, SmartGIFT.

[119]  Christopher Luppe,et al.  Towards reliable intelligent occupancy detection for smart building applications , 2017, 2017 IEEE 30th Canadian Conference on Electrical and Computer Engineering (CCECE).

[120]  Brad J. Sagarin,et al.  Drawing power of virtual crowds , 2018, Journal of The Royal Society Interface.

[121]  Iason Konstantzos,et al.  Occupant interactions with shading and lighting systems using different control interfaces: A pilot field study , 2016 .

[122]  Tianzhen Hong,et al.  Advances in research and applications of energy-related occupant behavior in buildings ☆ , 2016 .

[123]  Tianzhen Hong,et al.  A simulation approach to estimate energy savings potential of occupant behavior measures , 2017 .

[124]  Milos Manic,et al.  Building Energy Management Systems: The Age of Intelligent and Adaptive Buildings , 2016, IEEE Industrial Electronics Magazine.

[125]  Adam Gazzaley,et al.  Exploring the Potential of the iPad and Xbox Kinect for Cognitive Science Research. , 2015, Games for health journal.

[126]  Alessandra Flammini,et al.  Adopting IoT framework for Energy Management of Smart Building: A real test-case , 2015, 2015 IEEE 1st International Forum on Research and Technologies for Society and Industry Leveraging a better tomorrow (RTSI).

[127]  Kathryn B. Janda,et al.  From “if only” to “social potential” in schemes to reduce building energy use , 2014 .

[128]  Zhong Lin Wang,et al.  Versatile Core–Sheath Yarn for Sustainable Biomechanical Energy Harvesting and Real‐Time Human‐Interactive Sensing , 2018, Advanced Energy Materials.

[129]  Burcin Becerik-Gerber,et al.  Influence of LEED branding on building occupants' pro-environmental behavior , 2015 .

[131]  William Thompson,et al.  A Transmitter—Receiver System for Long-Range Capacitive Sensing Applications , 2016, IEEE Transactions on Instrumentation and Measurement.

[132]  Nirmalya Roy,et al.  UnTran: Recognizing Unseen Activities with Unlabeled Data Using Transfer Learning , 2018, 2018 IEEE/ACM Third International Conference on Internet-of-Things Design and Implementation (IoTDI).

[133]  Zhong Lin Wang,et al.  Highly Stretchable 2D Fabrics for Wearable Triboelectric Nanogenerator under Harsh Environments. , 2015, ACS nano.

[134]  Carlos Cardeira,et al.  Family Houses Energy Consumption Forecast Tools for Smart Grid Management , 2017 .

[135]  Burcin Becerik-Gerber,et al.  Default Conditions: A Reason for Design to Integrate Human Factors , 2015 .

[136]  Koushik Kar,et al.  Incentive-Based Mechanism for Truthful Occupant Comfort Feedback in Human-in-the-Loop Building Thermal Management , 2018, IEEE Systems Journal.

[137]  Gerd Kortuem,et al.  Designing for Effective Interactions with Data in the Internet of Things , 2018, Conference on Designing Interactive Systems.

[138]  Jili Zhang,et al.  Experimental research of online monitoring and evaluation method of human thermal sensation in different active states based on wristband device , 2018, Energy and Buildings.

[139]  Dario Maio,et al.  Joint Orientations from Skeleton Data for Human Activity Recognition , 2017, ICIAP.

[140]  Damith Chinthana Ranasinghe,et al.  Sequence Learning with Passive RFID Sensors for Real-Time Bed-Egress Recognition in Older People , 2017, IEEE Journal of Biomedical and Health Informatics.

[141]  Tobias Nef,et al.  Passive wireless sensor systems can recognize activites of daily living , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[142]  Yacine Rezgui,et al.  Building energy metering and environmental monitoring – A state-of-the-art review and directions for future research , 2016 .

[143]  Duen-Ren Liu,et al.  Product Recommendations Based on the Bandwagon Effect of Virtual Houses in Virtual Worlds , 2016, 2016 5th IIAI International Congress on Advanced Applied Informatics (IIAI-AAI).

[144]  Gérald Rocher,et al.  A Possibilistic I/O Hidden Semi-Markov Model For Assessing Cyber-Physical Systems Effectiveness , 2018, 2018 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[145]  Dan Negrut,et al.  Synchrono: An open-source framework for physics-based simulation of collaborating robots , 2018, 2018 IEEE International Conference on Simulation, Modeling, and Programming for Autonomous Robots (SIMPAR).

[146]  Joaquín Ordieres-Meré,et al.  An IoT−based system that aids learning from human behavior: A potential application for the care of the elderly , 2017 .

[147]  Kathrin Maria Gerling,et al.  Virtual reality crowd simulation: effects of agent density on user experience and behaviour , 2018, Virtual Reality.

[148]  Fabio Massimo Zanzotto Human-in-the-loop Artificial Intelligence , 2017, ArXiv.

[149]  Y. Edan,et al.  SIT LESS: A prototype home-based system for monitoring older adults sedentary behavior , 2018, Assistive technology : the official journal of RESNA.

[150]  George-Christopher Vosniakos,et al.  Design of a virtual reality training system for human–robot collaboration in manufacturing tasks , 2015, International Journal on Interactive Design and Manufacturing (IJIDeM).

[151]  Soumyajit Mandal,et al.  An “Internet of Ears” for crowd-aware smart buildings based on sparse sensor networks , 2017, 2017 IEEE SENSORS.

[152]  Kyong-Ho Lee,et al.  Enabling smart objects discovery via constructing hypergraphs of heterogeneous IoT interactions , 2016, J. Inf. Sci..

[153]  Ping Huang,et al.  pCSSL: A stochastic extension to MARTE/CCSL for modeling uncertainty in Cyber Physical Systems , 2018, Sci. Comput. Program..

[154]  Dan Yang,et al.  Indoor human localization using PIR sensors and accessibility map , 2015, 2015 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER).

[155]  Jin Wen,et al.  Relating occupant perceived control and thermal comfort: Statistical analysis on the ASHRAE RP-884 database , 2012 .

[156]  Jan Vanus,et al.  Design of Smart Home Implementation within IoT with Natural Language Interface , 2018 .

[157]  Erik Wilhelm,et al.  Determining air-conditioning usage patterns in Singapore from distributed, portable sensors , 2017 .

[158]  Burcin Becerik-Gerber,et al.  Use of immersive virtual environments for occupant behaviour monitoring and data collection , 2017 .

[159]  João L. Afonso,et al.  An Energy Management Platform for Public Buildings , 2018, Electronics.

[160]  Sanaz Saeidi,et al.  Application of Immersive Virtual Environments for Longitudinal Data Collection: A Pilot Study , 2018 .

[161]  Tianzhen Hong,et al.  Synthesizing building physics with social psychology: An interdisciplinary framework for context and occupant behavior in office buildings , 2017 .

[162]  Xiao-Sheng Zhang,et al.  Wearable electrode-free triboelectric generator for harvesting biomechanical energy , 2015 .

[163]  P Pieter-Jan Hoes,et al.  International survey on current occupant modelling approaches in building performance simulation† , 2017 .

[164]  Mohammad Yusri Hassan,et al.  A review on lighting control technologies in commercial buildings, their performance and affecting factors , 2014 .

[165]  Azin Semsar,et al.  Human interaction with IoT-based smart environments , 2017, Multimedia Tools and Applications.

[166]  Chuang Wang,et al.  A preliminary research on the derivation of typical occupant behavior based on large-scale questionnaire surveys , 2016 .

[167]  Kingshuk Chakravarty,et al.  A Framework for Pervasive and Ubiquitous Geriatric Monitoring , 2018, HCI.

[168]  Jianhua Ma,et al.  A survey: Cyber-physical-social systems and their system-level design methodology , 2016, Future Gener. Comput. Syst..

[169]  Yitong Huang How to Design Internet of Things to Encourage Office Workers to Take More Regular Micro-Breaks , 2016, ECCE.

[170]  Jinping Li,et al.  A new action recognition method by distinguishing ambiguous postures , 2018 .

[171]  Z. Liu,et al.  Flexible piezoelectric nanogenerator in wearable self-powered active sensor for respiration and healthcare monitoring , 2017 .

[172]  Ugo Fiore,et al.  Planning and operational energy optimization solutions for smart buildings , 2019, Inf. Sci..

[173]  Tae Yun Kim,et al.  Nanopatterned textile-based wearable triboelectric nanogenerator. , 2015, ACS nano.

[174]  S. Athira,et al.  Smart mirror: A novel framework for interactive display , 2016, 2016 International Conference on Circuit, Power and Computing Technologies (ICCPCT).

[175]  Qi Hao,et al.  Active Compressive Sensing via Pyroelectric Infrared Sensor for Human Situation Recognition , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[176]  D. Mandal,et al.  An Effective Wind Energy Harvester of Paper Ash-Mediated Rapidly Synthesized ZnO Nanoparticle-Interfaced Electrospun PVDF Fiber , 2018 .

[177]  Burcin Becerik-Gerber,et al.  Benchmarking thermoception in virtual environments to physical environments for understanding human-building interactions , 2018, Adv. Eng. Informatics.

[178]  Akira Mita,et al.  Emotion identification method using RGB information of human face , 2015, Smart Structures.

[179]  Michael Beetz,et al.  Robots, Pancakes, and Computer Games: Designing Serious Games for Robot Imitation Learning , 2015, CHI.

[180]  Michael B. Kane Modeling Human-in-the-Loop Behavior and Interactions with HVAC Systems , 2018, 2018 Annual American Control Conference (ACC).

[181]  Chris D. Nugent,et al.  From Activity Recognition to Intention Recognition for Assisted Living Within Smart Homes , 2017, IEEE Transactions on Human-Machine Systems.

[182]  Maneesha Vinodini Ramesh,et al.  Design and Implementation of Context Aware Cyber Physical System for Sustainable Smart Building , 2018, 2018 International Conference on Smart Grid and Clean Energy Technologies (ICSGCE).

[183]  O. T. Masoso,et al.  The dark side of occupants’ behaviour on building energy use , 2010 .

[184]  W Wim Zeiler,et al.  Human-in-the-loop energy flexibility integration on a neighbourhood level: Small and Big Data management , 2019, Building Services Engineering Research and Technology.

[185]  Káthia Marçal de Oliveira,et al.  Evaluating an IoT Application Using Software Measures , 2017, HCI.

[186]  Supratik Mukhopadhyay,et al.  Enhancing the Prediction of Artificial Lighting Control Behavior Using Virtual Reality (VR): A Pilot Study , 2018 .

[187]  M. Radovan,et al.  Trends in IoT security , 2017, 2017 40th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO).

[188]  Hui Lin,et al.  Framework for Virtual Cognitive Experiment in Virtual Geographic Environments , 2018, ISPRS Int. J. Geo Inf..

[189]  Christopher W. Geib,et al.  Architectures for Activity Recognition and Context-Aware Computing , 2015, AI Mag..

[190]  Marco Zuniga,et al.  Sensor-driven, human-in-the-loop lighting control , 2018 .

[191]  Nader Mohamed,et al.  On the Complexity of Smart Buildings Occupant Behavior: Risks and Opportunities , 2017, BCI.

[192]  Siobhán Clarke,et al.  Enablement of IoT Based Context-Aware Smart Home with Fog Computing , 2017, J. Cases Inf. Technol..

[193]  Kai Hansen Designing responsive environments through User Experience research , 2016 .

[194]  Farrokh Aminifar,et al.  IoT-Enabled Humans in the Loop for Energy Management Systems: Promoting Building Occupants' Participation in Optimizing Energy Consumption , 2018, IEEE Electrification Magazine.

[195]  Sanaz Saeidi,et al.  Spatial-temporal event-driven modeling for occupant behavior studies using immersive virtual environments , 2018, Automation in Construction.

[196]  Ardeshir Mahdavi,et al.  IEA EBC Annex 66: Definition and simulation of occupant behavior in buildings , 2017 .

[197]  Zoltán Nagy,et al.  Comprehensive analysis of the relationship between thermal comfort and building control research - A data-driven literature review , 2018 .

[198]  Wenwei Yu,et al.  Active Sensing for Human Activity Recognition by a Home Bio-monitoring Robot in a Home Living Environment , 2016, IAS.

[199]  Antonio F. Gómez-Skarmeta,et al.  An IoT based framework for user-centric smart building services , 2015, Int. J. Web Grid Serv..

[200]  Dwi Pebrianti,et al.  Wireless PIR & D6T thermal sensor based lighting & airconditioning control device for building , 2016 .

[201]  Farrokh Jazizadeh,et al.  Human-in-the-loop HVAC operations: A quantitative review on occupancy, comfort, and energy-efficiency dimensions , 2019, Applied Energy.

[202]  Diane J. Cook,et al.  Guest EditorialSpecial Issue on Situation, Activity, and Goal Awareness in Cyber-Physical Human-Machine Systems , 2017, IEEE Trans. Hum. Mach. Syst..

[203]  Chi-Sheng Shih,et al.  Context and user behavior aware intelligent home control using WuKong middleware , 2015, 2015 IEEE International Conference on Consumer Electronics - Taiwan.

[204]  Qian Zhang,et al.  Development, applications, and future directions of triboelectric nanogenerators , 2018, Nano Research.

[205]  Yixing Chen,et al.  Occupant behavior models: A critical review of implementation and representation approaches in building performance simulation programs , 2018 .

[206]  Fatemeh Afghah,et al.  Design and Implementation of an Autonomous Wireless Sensor-Based Smart Home , 2015, 2015 24th International Conference on Computer Communication and Networks (ICCCN).

[207]  Jin Wen,et al.  Net-zero energy building clusters emulator for energy planning and operation evaluation , 2017, Comput. Environ. Urban Syst..

[208]  Hae Young Noh,et al.  Multiple Pedestrian Tracking through Ambient Structural Vibration Sensing: Poster Abstract , 2016, SenSys.

[209]  Quang Vinh Nguyen,et al.  Passive RFID Localisation Framework in Smart Homes Healthcare Settings. , 2016, Studies in health technology and informatics.

[210]  Mohsen Guizani,et al.  Discovering Communities of Malapps on Android-based Mobile Cyber-physical Systems , 2018, Ad Hoc Networks.

[211]  Hongmin Wu,et al.  Kinect-based robotic manipulation: From human hand to end-effector , 2015, 2015 IEEE 10th Conference on Industrial Electronics and Applications (ICIEA).

[212]  Kisu Ok,et al.  Space inference system for buildings using IoT , 2017, ICCIP '17.

[213]  Emanuele Frontoni,et al.  HDOMO: Smart Sensor Integration for an Active and Independent Longevity of the Elderly , 2017, Sensors.

[214]  Tomislav Dragicevic,et al.  Future effectual role of energy delivery: A comprehensive review of Internet of Things and smart grid , 2018, Renewable and Sustainable Energy Reviews.

[215]  Ebrahim Bagheri,et al.  Location-Aware Human Activity Recognition , 2017, ADMA.

[216]  Umesh Chandra Pati,et al.  IoT based intrusion detection system using PIR sensor , 2017, 2017 2nd IEEE International Conference on Recent Trends in Electronics, Information & Communication Technology (RTEICT).

[217]  Frederik Gossen Bayesian recognition of human identities from continuous visual features for safe and secure access in healthcare environments , 2015, 2015 10th International Conference on Design & Technology of Integrated Systems in Nanoscale Era (DTIS).

[218]  Juan A. Besada,et al.  A Kinect-based system to enable interaction by pointing in smart spaces , 2015, 2015 IEEE Sensors Applications Symposium (SAS).

[219]  A. Alhogail,et al.  Building Consumer Trust to Improve Internet of Things (IoT) Technology Adoption , 2018, Advances in Neuroergonomics and Cognitive Engineering.

[220]  Damian M. Lyons,et al.  Using a 3D World to Address Perceptual Issues in Human-robot Coordination , 2015 .

[221]  Timo Hartmann,et al.  Civil Systems Engineering: Definition and Basic Concepts , 2018 .

[222]  Hannes Kaufmann,et al.  Automatic Furniture Arrangement Using Greedy Cost Minimization , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[223]  Akira Mita,et al.  Recognition of human activities using depth images of Kinect for biofied building , 2015, Smart Structures.

[224]  Vitaly Shmatikov,et al.  A Scanner Darkly: Protecting User Privacy from Perceptual Applications , 2013, 2013 IEEE Symposium on Security and Privacy.

[225]  Roger Gassert,et al.  A method to qualitatively assess arm use in stroke survivors in the home environment , 2016, Medical & Biological Engineering & Computing.

[226]  Mario Kusek,et al.  Activity Detection in Smart Home Environment , 2016, KES.

[227]  Simon Fong,et al.  Training Classifiers with Shadow Features for Sensor-Based Human Activity Recognition , 2017, Sensors.

[228]  Kamin Whitehouse,et al.  Plaster: an integration, benchmark, and development framework for metadata normalization methods , 2018, BuildSys@SenSys.

[229]  Paolo Bellavista,et al.  The PeRvasive Environment Sensing and Sharing Solution , 2017 .

[230]  Alberto L. Sangiovanni-Vincentelli,et al.  Design Automation for Smart Building Systems , 2018, Proceedings of the IEEE.

[231]  Uri Alon,et al.  A reduced-dimensionality approach to uncovering dyadic modes of body motion in conversations , 2017, PloS one.

[232]  Partha Pratim Ray A survey on Internet of Things architectures , 2018, J. King Saud Univ. Comput. Inf. Sci..

[233]  Paulo Menezes,et al.  Information Model and Architecture Specification for Context Awareness Interaction Decision Support in Cyber-Physical Human–Machine Systems , 2017, IEEE Transactions on Human-Machine Systems.

[234]  Akira Mita,et al.  Gait Parameter Acquisition While Chasing Resident Using Home Robot , 2017 .

[235]  Jaroslaw Domaszewicz,et al.  Soft Actuation: Smart Home and Office with Human-in-the-Loop , 2016, IEEE Pervasive Computing.

[236]  Yimin Zhu,et al.  Measuring the Effectiveness of an Immersive Virtual Environment for the Modeling and Prediction of Occupant Behavior , 2015 .

[237]  Aljoscha Pörtner,et al.  Smart Fall: Accelerometer-Based Fall Detection in a Smart Home Environment , 2015, ICOST.

[238]  Marina L. Gavrilova,et al.  User Recognition From Social Behavior in Computer-Mediated Social Context , 2017, IEEE Transactions on Human-Machine Systems.

[239]  Yimin Zhu,et al.  Application of Immersive Virtual Environment (IVE) in Occupant Energy-Use Behavior Studies Using Physiological Responses , 2017 .

[240]  John Lygeros,et al.  Humans in the Loop: A Stochastic Predictive Approach to Building Energy Management in the Presence of Unpredictable Users , 2017 .

[241]  Massimo de Vittorio,et al.  Fluids energy harvesting system with low cut-in velocity piezoelectric MEMS , 2017, 2017 IEEE International Conference on IC Design and Technology (ICICDT).

[242]  Dongwoo Yeom,et al.  Investigation of physiological differences between immersive virtual environment and indoor environment in a building , 2017 .

[243]  Olga Galinina,et al.  Smart home gateway system over Bluetooth low energy with wireless energy transfer capability , 2015, EURASIP J. Wirel. Commun. Netw..

[244]  Burcin Becerik-Gerber,et al.  Immersive virtual environments, understanding the impact of design features and occupant choice upon lighting for building performance , 2015 .

[245]  Shelly Levy-Tzedek,et al.  Smooth leader or sharp follower? Playing the mirror game with a robot , 2017, Restorative neurology and neuroscience.

[246]  Jan Haase,et al.  The IOT mediated built environment: A brief survey , 2016, 2016 IEEE 14th International Conference on Industrial Informatics (INDIN).

[247]  Thi-Lan Le,et al.  Continuous detection of human fall using multimodal features from Kinect sensors in scalable environment , 2017, Comput. Methods Programs Biomed..

[248]  Arsalan Heydarian,et al.  Towards user centered building design: Identifying end-user lighting preferences via immersive virtual environments , 2017 .

[249]  Silvia Rossi,et al.  Robot head movements and human effort in the evaluation of tracking performance , 2015, 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[250]  Ardeshir Mahdavi,et al.  A preliminary study of representing the inter-occupant diversity in occupant modelling , 2017 .

[251]  Weihua Sheng,et al.  Indoor human tracking and state estimation by fusing environmental sensors and wearable sensors , 2015, 2015 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER).

[252]  Kazushi Ikeda,et al.  In-home measurement system of user's motion and center of pressure , 2015, 2015 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA).

[253]  Nan Li,et al.  Linking energy-cyber-physical systems with occupancy prediction and interpretation through WiFi probe-based ensemble classification , 2019, Applied Energy.