SimCon: A context simulator for supporting evaluation of smart building applications when faced with uncertainty

Abstract Smart Building Applications (SBAs) adapt their behaviour in response to context information generated by sensors present in the smart building. SBA developers must account for uncertainty in the accuracy of context information resulting from imperfection in the sensing technology and potentially complex interactions between the sensed phenomenon, the sensor and the physical environment. To address this challenge, context simulators which generate simulated context information have been developed. A number of key challenges must be addressed before such a simulation-based SBA prototyping approach can become widely used. First, any context simulator must be flexible in its approach to simulating context so that it supports evaluating different mixes of SBAs using a selection of methods most suitable to the evaluation task at hand. Second, the context simulator must support simulating uncertainty in context as uncertainty can cause an SBA to function incorrectly. Finally, the process of setting up a simulation should be efficient in use, satisfying to the developer and also, be effective in correctly evaluating the SBA behaviour. This paper presents the SimCon model which addresses these challenges by supporting simulation of context, in particular location context, with configurable levels of uncertainty for evaluating SBAs using visualisation. The SimCon model has been implemented in a simulation, configuration and visualisation tool set which has undergone a number of evaluations with SBA developers to determine and improve its level of usability, the most recent of which is presented here.

[1]  Nigel Bevan,et al.  Common Industry Format Usability Tests , 1999 .

[2]  Thomas Weng,et al.  Occupancy-driven energy management for smart building automation , 2010, BuildSys '10.

[3]  Declan O'Sullivan,et al.  The SimCon Generator: An interactive context simulator for rapid evaluation of Smart Building Applications using Virtual Reality , 2011, 2011 IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops).

[4]  R. Cheung An adaptive middleware infrastructure incorporating fuzzy logic for mobile computing , 2005, International Conference on Next Generation Web Services Practices (NWeSP'05).

[5]  Jadwiga Indulska,et al.  A survey of context modelling and reasoning techniques , 2010, Pervasive Mob. Comput..

[6]  Kris McGlinn,et al.  Pervasive knowledge-based networking for maintenance inspection in smart buildings. , 2009, MUCS '09.

[7]  Wolfgang Effelsberg,et al.  A study on user acceptance of error visualization techniques , 2008, Mobiquitous 2008.

[8]  Young-Koo Lee,et al.  Modeling and reasoning about uncertainty in context-aware systems , 2005, IEEE International Conference on e-Business Engineering (ICEBE'05).

[9]  Byunghun Song,et al.  Surveillance Tracking System Using Passive Infrared Motion Sensors in Wireless Sensor Network , 2008, 2008 International Conference on Information Networking.

[10]  Shuo-Yan Chou,et al.  Location-aware tour guide systems in museum. , 2008 .

[11]  Gul A. Agha,et al.  SENS: a sensor, environment and network simulator , 2004, 37th Annual Simulation Symposium, 2004. Proceedings..

[12]  Kori Inkpen Quinn,et al.  Evaluating early prototypes in context: trade-offs, challenges, and successes , 2005, IEEE Pervasive Computing.

[13]  Gilbert Cockton,et al.  Why and when five test users aren’t enough , 2001 .

[14]  B. Thomas,et al.  Usability Evaluation In Industry , 1996 .

[15]  Eleanor O'Neill,et al.  Situation-based testing for ubiquitous computing systems , 2011 .

[16]  James A. Landay,et al.  Guest Editors' Introduction: Rapid Prototyping for Ubiquitous Computing , 2005, IEEE Pervasive Comput..

[17]  Vinny Cahill,et al.  Requirements for an ubiquitous computing simulation and emulation environment , 2006, InterSense '06.

[18]  Timo Jokela,et al.  The standard of user-centered design and the standard definition of usability: analyzing ISO 13407 against ISO 9241-11 , 2003, CLIHC '03.

[19]  Yaxin Bi,et al.  Using the Dempster–Shafer Theory of Evidence With a Revised Lattice Structure for Activity Recognition , 2011, IEEE Transactions on Information Technology in Biomedicine.

[20]  Philip T. Kortum,et al.  Determining what individual SUS scores mean: adding an adjective rating scale , 2009 .

[21]  Fredrik Espinoza,et al.  Testing and demonstrating context-aware services with Quake III Arena , 2002, CACM.

[22]  Tatsuya Yamazaki,et al.  Ubiquitous home: real-life testbed for home context-aware service , 2005, First International Conference on Testbeds and Research Infrastructures for the DEvelopment of NeTworks and COMmunities.

[23]  Yang Li,et al.  Design Challenges and Principles for Wizard of Oz Testing of Location-Enhanced Applications , 2007, IEEE Pervasive Computing.

[24]  Diane J. Cook,et al.  Smart environments - technology, protocols and applications , 2004 .

[25]  Hung Keng Pung,et al.  A BAYESIAN APPROACH FOR DEALING WITH UNCERTAIN CONTEXTS , 2004 .

[26]  Jakob Nielsen,et al.  A mathematical model of the finding of usability problems , 1993, INTERCHI.

[27]  Oscar Mauricio Serrano Jaimes,et al.  EVALUACION DE LA USABILIDAD EN SITIOS WEB, BASADA EN EL ESTANDAR ISO 9241-11 (International Standard (1998) Ergonomic requirements For office work with visual display terminals (VDTs)-Parts II: Guidance on usability , 2012 .

[28]  David Lewis,et al.  Modeling and simulation to assist context aware system design , 2011, Simul..

[29]  Jumphon Lertlakkhanakul,et al.  Building data model and simulation platform for spatial interaction management in smart home , 2008 .

[30]  Daniel Retkowitz,et al.  Simulation of Smart Environments , 2007, IEEE International Conference on Pervasive Services.

[31]  George Coulouris,et al.  A Generic Location Event Simulator , 2002, UbiComp.

[32]  Gero Mühl,et al.  Rapid Prototyping for Pervasive Applications , 2007, IEEE Pervasive Computing.

[33]  Eyal de Lara,et al.  An Exploration of Location Error Estimation , 2007, UbiComp.

[34]  John A. Stankovic,et al.  Context-aware wireless sensor networks for assisted living and residential monitoring , 2008, IEEE Network.

[35]  Helmut Prendinger,et al.  A Simulation Framework for Sensor-Based Systems in Second Life , 2009, PRESENCE: Teleoperators and Virtual Environments.

[36]  Mary Corbett,et al.  SUMI: the Software Usability Measurement Inventory , 1993, Br. J. Educ. Technol..

[37]  Thomas S. Tullis,et al.  A Comparison of Questionnaires for Assessing Website Usability , 2004 .

[38]  Charles Consel DiaSuite: a paradigm-oriented software development approach , 2011, PEPM '11.

[39]  Bernt Schiele,et al.  Towards improving trust in context-aware systems by displaying system confidence , 2005, Mobile HCI.

[40]  Sunny Consolvo,et al.  User Study Techniques in the Design and Evaluation of a Ubicomp Environment , 2002, UbiComp.

[41]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[42]  L. Barclay Propagation of radiowaves , 2003 .

[43]  Alexander De Luca,et al.  Visualization of uncertainty in context aware mobile applications , 2006, Mobile HCI.

[44]  Mohamed Medhat Gaber,et al.  Reasoning about Context in Uncertain Pervasive Computing Environments , 2008, EuroSSC.

[45]  Anind K. Dey,et al.  Investigating intelligibility for uncertain context-aware applications , 2011, UbiComp '11.

[46]  Jesús Favela,et al.  Uncertainty Management in Context-Aware Applications: Increasing Usability and User Trust , 2011, Wirel. Pers. Commun..

[47]  Albrecht Schmidt,et al.  Designing, Developing, and Evaluating Context-Aware Systems , 2007, 2007 International Conference on Multimedia and Ubiquitous Engineering (MUE'07).

[48]  Bernard Burg,et al.  An Approach to Data Fusion for Context Awareness , 2005, CONTEXT.

[49]  Steve Northover,et al.  SWT : the standard widget toolkit , 2004 .

[50]  Wilfried Jouve,et al.  DiaSim: A parameterized simulator for pervasive computing applications , 2009, 2009 6th Annual International Mobile and Ubiquitous Systems: Networking & Services, MobiQuitous.

[51]  Tom H. F. Broens,et al.  SimuContext: Simply Simulate Context , 2006, International Conference on Autonomic and Autonomous Systems (ICAS'06).

[52]  Simon A. Dobson,et al.  Resolving uncertainty in context integration and abstraction: context integration and abstraction , 2008, ICPS '08.

[53]  Juan Ye,et al.  Using Situation Lattices to Model and Reason about Context , 2007 .

[54]  Siobhán Clarke,et al.  CASS - Middleware for Mobile Context-Aware Applications , 1990 .

[55]  Jennifer Mankoff,et al.  Prototypes in the wild lessons from three ubicomp systems , 2005, IEEE Pervasive Computing.

[56]  Roy H. Campbell,et al.  Reasoning about Uncertain Contexts in Pervasive Computing Environments , 2004, IEEE Pervasive Comput..

[57]  Kent L. Norman,et al.  Development of an instrument measuring user satisfaction of the human-computer interface , 1988, CHI '88.

[58]  Gregory D. Abowd,et al.  The Aware Home: A Living Laboratory for Ubiquitous Computing Research , 1999, CoBuild.

[59]  Keiichi Yasumoto,et al.  UbiREAL: Realistic Smartspace Simulator for Systematic Testing , 2006, UbiComp.

[60]  Declan O'Sullivan,et al.  SimCon: A Tool to Support Rapid Evaluation of Smart Building Application Design using Context Simulation and Virtual Reality , 2010, J. Univers. Comput. Sci..

[61]  Felix Klar,et al.  3DSim: rapid prototyping ambient intelligence , 2005, sOc-EUSAI '05.

[62]  Jeff Sauro,et al.  A method to standardize usability metrics into a single score , 2005, CHI.

[63]  Jiannong Cao,et al.  Service adaptation using fuzzy theory in context-aware mobile computing middleware , 2005, 11th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA'05).

[64]  Henry A. Kautz,et al.  Learning and inferring transportation routines , 2004, Artif. Intell..

[65]  Jesús Favela,et al.  Activity Recognition for the Smart Hospital , 2008, IEEE Intelligent Systems.

[66]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[67]  Jie Yang,et al.  Sensor Fusion Using Dempster-Shafer Theory , 2002 .