Spatiotemporal data visualisation for homecare monitoring of elderly people

OBJECTIVE Elderly people who live alone can be assisted by home monitoring systems that identify risk scenarios such as falls, fatigue symptoms or burglary. Given that these systems have to manage spatiotemporal data, human intervention is required to validate automatic alarms due to the high number of false positives and the need for context interpretation. The goal of this work was to provide tools to support human action, to identify such potential risk scenarios based on spatiotemporal data visualisation. METHODS AND MATERIALS We propose the MTA (multiple temporal axes) model, a visual representation of temporal information of the activity of a single person at different locations. The main goal of this model is to visualize the behaviour of a person in their home, facilitating the identification of health-risk scenarios and repetitive patterns. We evaluate the model's insight capacity compared with other models using a standard evaluation protocol. We also test its practical suitability of the MTA graphical model in a commercial home monitoring system. In particular, we implemented 8VISU, a visualization tool based on MTA. RESULTS MTA proved to be more than 90% accurate in identify non-risk scenarios, independently of the length of the record visualised. When the spatial complexity was increased (e.g. number of rooms) the model provided good accuracy form up to 5 rooms. Therefore, user preferences and user performance seem to be balanced. Moreover, it also gave high sensitivity levels (over 90%) for 5-8 rooms. Fall is the most recurrent incident for elderly people. The MTA model outperformed the other models considered in identifying fall scenarios (66% of correctness) and was the second best for burglary and fatigue scenarios (36% of correctness). Our experiments also confirm the hypothesis that cyclic models are the most suitable for fatigue scenarios, the Spiral and MTA models obtaining most positive identifications. CONCLUSIONS In home monitoring systems, spatiotemporal visualization is a useful tool for identifying risk and preventing home accidents in elderly people living alone. The MTA model helps the visualisation in different stages of the temporal data analysis process. In particular, its explicit representation of space and movement is useful for identifying potential scenarios of risk, while the spiral structure can be used for the identification of recurrent patterns. The results of the experiments and the experience using the visualization tool 8VISU proof the potential of the MTA graphical model to mine temporal data and to support caregivers using home monitoring infrastructures.

[1]  Robert S. Laramee,et al.  Smooth Graphs for Visual Exploration of Higher-Order State Transitions , 2009, IEEE Transactions on Visualization and Computer Graphics.

[2]  Beverly L. Harrison,et al.  Timelines: An Interactive System for the Collection and Visualization of Temporal Data , 1994 .

[3]  Jeffrey Heer,et al.  D³ Data-Driven Documents , 2011, IEEE Transactions on Visualization and Computer Graphics.

[4]  Martin Wattenberg,et al.  Visual exploration of multivariate graphs , 2006, CHI.

[5]  Jeffrey Heer,et al.  SpanningAspectRatioBank Easing FunctionS ArrayIn ColorIn Date Interpolator MatrixInterpola NumObjecPointI Rectang ISchedu Parallel Pause Scheduler Sequen Transition Transitioner Transiti Tween Co DelimGraphMLCon IData JSONCon DataField DataSc Dat DataSource Data DataUtil DirtySprite LineS RectSprite , 2011 .

[6]  Filippo Cavallo,et al.  AALIANCE Ambient Assisted Living Roadmap , 2010, Ambient Intelligence and Smart Environments.

[7]  Masahito Hirakawa,et al.  Interactive visualization of spatiotemporal patterns using spirals on a geographical map , 1999, Proceedings 1999 IEEE Symposium on Visual Languages.

[8]  Chenchaomei,et al.  Empirical studies of information visualization , 2000 .

[9]  Marc Alexa,et al.  Visualizing time-series on spirals , 2001, IEEE Symposium on Information Visualization, 2001. INFOVIS 2001..

[10]  Juan A. Botía Blaya,et al.  Ambient Assisted Living system for in-home monitoring of healthy independent elders , 2012, Expert Syst. Appl..

[11]  Francesco Pinciroli,et al.  Visualizing Temporal Clinical Data on the WWW , 1999, AIMDM.

[12]  Jarke J. van Wijk,et al.  Eurographics/ Ieee-vgtc Symposium on Visualization 2008 Visual Inspection of Multivariate Graphs , 2022 .

[13]  Juan A. Botía Blaya,et al.  Modeling a Risk Detection System for Elderly's Home-Care with a Network of Timed Automata , 2012, IWAAL.

[14]  Silvia Miksch,et al.  Connecting time-oriented data and information to a coherent interactive visualization , 2004, CHI.

[15]  Ben Shneiderman,et al.  LifeLines: using visualization to enhance navigation and analysis of patient records , 1998, AMIA.

[16]  Manuel Campos,et al.  Multiple Temporal Axes for Visualising the Behaviour of Elders Living Alone , 2013, 2013 IEEE International Conference on Healthcare Informatics.

[17]  James F. Allen Maintaining knowledge about temporal intervals , 1983, CACM.

[18]  Pierre Dragicevic,et al.  SpiraClock: a continuous and non-intrusive display for upcoming events , 2002, CHI Extended Abstracts.

[19]  Eduard Gröller,et al.  Event Tunnel: Exploring Event-Driven Business Processes , 2008, IEEE Computer Graphics and Applications.

[20]  Carst Tankink,et al.  Improving an interactive visualization of transition systems , 2008, SOFTVIS.

[21]  Raimund Dachselt,et al.  TimeZoom: a flexible detail and context timeline , 2006, CHI EA '06.

[22]  Mary Czerwinski,et al.  Empirical evaluation of information visualizations: an introduction , 2000, Int. J. Hum. Comput. Stud..

[23]  Heidrun Schumann,et al.  Visualization of Time-Oriented Data , 2011, Human-Computer Interaction Series.

[24]  Ben Shneiderman,et al.  LifeFlow: visualizing an overview of event sequences , 2011, CHI.

[25]  Chaomei Chen,et al.  Empirical studies of information visualization: a meta-analysis , 2000, Int. J. Hum. Comput. Stud..

[26]  John V. Carlis,et al.  Interactive visualization of serial periodic data , 1998, UIST '98.

[27]  Purviben Bharatkumar Saraiya,et al.  Insight-Based Studies for Pathway and Microarray Visualization Tools , 2006 .

[28]  Ben Shneiderman,et al.  LifeLines: visualizing personal histories , 1996, CHI.

[29]  Chenchaomei,et al.  Empirical evaluation of information visualizations , 2000 .

[30]  M. Sheelagh T. Carpendale,et al.  Empirical Studies in Information Visualization: Seven Scenarios , 2012, IEEE Transactions on Visualization and Computer Graphics.

[31]  Michael G. Kahn,et al.  The visual display of temporal information , 1991, Artif. Intell. Medicine.

[32]  Heidrun Schumann,et al.  A framework for visual data mining of structures , 2006, ACSC.

[33]  Silvia Miksch,et al.  CareVis: Integrated visualization of computerized protocols and temporal patient data , 2006, Artif. Intell. Medicine.

[34]  Yuval Shahar,et al.  Distributed, intelligent, interactive visualization and exploration of time-oriented clinical data and their abstractions , 2006, Artif. Intell. Medicine.

[35]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .