Visual process maps: a visualization tool for discovering habits in smart homes

Models of human habits in smart spaces can be expressed by using a multitude of representations whose readability influences the possibility of being validated by human experts. The visual analysis by domain experts allows to identify stages of human habits that could be automatized or simplified by redesigning the environment. In this paper, we present a visual analysis pipeline for graphically visualizing human habits, starting from the sensor log of a smart space,. We apply techniques borrowed from the area of business process automation and mining on a version of the sensor log preprocessed in order to translate raw sensor measurements into human actions. The proposed method is employed to automatically extract models to be reused for ambient intelligence. A user evaluation demonstrates the effectiveness of the approach, and compares it with respect to a relevant state-of-the-art visual tool, namely Situvis .

[1]  Harry Chen,et al.  An ontology for context-aware pervasive computing environments , 2003, The Knowledge Engineering Review.

[2]  Hans W. Guesgen,et al.  Spatiotemporal Reasoning for Smart Homes , 2006, Designing Smart Homes.

[3]  Diane J. Cook,et al.  Learning Setting-Generalized Activity Models for Smart Spaces , 2012, IEEE Intelligent Systems.

[4]  Seng Wai Loke.  Incremental awareness and compositionality: A design philosophy for context-aware pervasive systems , 2010, Pervasive Mob. Comput..

[5]  Diane J. Cook,et al.  COM: A method for mining and monitoring human activity patterns in home-based health monitoring systems , 2013, ACM Trans. Intell. Syst. Technol..

[6]  Natalia Sidorova,et al.  On Generation of Time-based Label Refinements , 2016, CS&P.

[7]  Jadwiga Indulska,et al.  A survey of context modelling and reasoning techniques , 2010, Pervasive Mob. Comput..

[8]  Claudio Bettini,et al.  Context-Aware Activity Recognition through a Combination of Ontological and Statistical Reasoning , 2009, UIC.

[9]  Juan Carlos Augusto,et al.  The Use of Temporal Reasoning and Management of Complex Events in Smart Homes , 2004, ECAI.

[10]  Ronald Poppe,et al.  A survey on vision-based human action recognition , 2010, Image Vis. Comput..

[11]  Jae-Gil Lee,et al.  Trajectory clustering: a partition-and-group framework , 2007, SIGMOD '07.

[12]  Seng Wai Loke,et al.  Logic Programming for Context-Aware Pervasive Computing: Language Support, Characterizing Situations, and Integration with the Web , 2004, IEEE/WIC/ACM International Conference on Web Intelligence (WI'04).

[13]  Wil M. P. van der Aalst,et al.  Process Mining , 2016, Springer Berlin Heidelberg.

[14]  Marlon Dumas,et al.  Predictive Business Process Monitoring with LSTM Neural Networks , 2016, CAiSE.

[15]  C. Gini.  Measurement of Inequality of Incomes , 1921 .

[16]  Heiner Stuckenschmidt,et al.  A probabilistic ontological framework for the recognition of multilevel human activities , 2013, UbiComp.

[17]  Wil M. P. van der Aalst,et al.  Event Abstraction for Process Mining using Supervised Learning Techniques , 2016, IntelliSys.

[18]  Hani Hagras,et al.  Toward Human-Understandable, Explainable AI , 2018, Computer.

[19]  Fabrizio Maria Maggi,et al.  Nirdizati: A Web-Based Tool for Predictive Process Monitoring , 2017, BPM.

[20]  BettiniClaudio,et al.  A survey of context modelling and reasoning techniques , 2010 .

[21]  Jan Mendling,et al.  Applying Process Mining to Smart Spaces: Perspectives and Research Challenges , 2015, CAiSE Workshops.

[22]  Marlon Dumas,et al.  Controlled automated discovery of collections of business process models , 2014, Inf. Syst..

[23]  Wil M. P. van der Aalst,et al.  Fuzzy Mining - Adaptive Process Simplification Based on Multi-perspective Metrics , 2007, BPM.

[24]  Juan Carlos Augusto,et al.  Management of Uncertainty and Spatio-Temporal Aspects for Monitoring and Diagnosis in a Smart Home , 2008 .

[25]  Tao Gu,et al.  A service-oriented middleware for building context-aware services , 2005, J. Netw. Comput. Appl..

[26]  Simon A. Dobson,et al.  Situation identification techniques in pervasive computing: A review , 2012, Pervasive Mob. Comput..

[27]  Diane J. Cook,et al.  Automatic Modeling of Frequent User Behaviours in Intelligent Environments , 2010, 2010 Sixth International Conference on Intelligent Environments.

[28]  Simon A. Dobson,et al.  Ontology-based models in pervasive computing systems , 2007, The Knowledge Engineering Review.

[29]  Jadwiga Indulska,et al.  Developing context-aware pervasive computing applications: Models and approach , 2006, Pervasive Mob. Comput..

[30]  Aaron J. Quigley,et al.  Situvis: A sensor data analysis and abstraction tool for pervasive computing systems , 2010, Pervasive Mob. Comput..

[31]  Roy H. Campbell,et al.  Use of Ontologies in Pervasive Computing Environments , 2003 .

[32]  Timo Sztyler,et al.  Unsupervised recognition of interleaved activities of daily living through ontological and probabilistic reasoning , 2016, UbiComp.

[33]  Diane J. Cook,et al.  Discovering frequent user--environment interactions in intelligent environments , 2011, Personal and Ubiquitous Computing.