A simulation tool for monitoring elderly who suffer from disorientation in a smart home

This paper addresses the challenging problem of disorientation of elderly people living at home. In order to detect confusion, we monitor the behaviour of the elderly and identify actions that appear alarming in a sensorized and video-controlled smart environment. In the past, our research has focused on identifying situations, activities and interactions between various actors based on user-understandable models. This work addresses the development of a simulation tool capable of synthesizing sensor data and low-level/medium-level scene events. The tool is of great interest with regard to the design and configuration of an elderly disorientation recognition system because it reduces the laborious and expensive need for experimentation with real devices. We integrate this proposal in a comprehensive framework that distinguishes between a recognition line and a simulation line in a potentially continuous and closed cycle. The recognition line goes from a multisensory monitored scene to its semantic interpretation, which could be completed even with only the narration of the facts. In the opposite direction, the simulation line goes from the narration of a scene to its synthesis with the same semantic content into a 3D simulation and the corresponding sensor signals and low/medium events at specific location points.

[1]  Philippe Chassagne,et al.  La confusion mentale chez les sujets âgés , 2005 .

[2]  Antonio Fernández-Caballero,et al.  Real-time human segmentation in infrared videos , 2011, Expert Syst. Appl..

[3]  Rafael Martínez-Tomás,et al.  Knowledge and Event-Based System for Video-Surveillance Tasks , 2009, IWINAC.

[4]  Antonio Fernández-Caballero,et al.  Optical flow or image subtraction in human detection from infrared camera on mobile robot , 2010, Robotics Auton. Syst..

[5]  Antonio Fernández-Caballero,et al.  Dynamic stereoscopic selective visual attention (DSSVA): Integrating motion and shape with depth in video segmentation , 2008, Expert Syst. Appl..

[6]  D. K. Steele,et al.  An ACE unit with a delirium room may improve function and equalize length of stay among older delirious medical inpatients. , 2010, The journals of gerontology. Series A, Biological sciences and medical sciences.

[7]  G. Berríos,et al.  Orientation Failures in Medicine and Psychiatry: Discussion Paper1 , 1983, Journal of the Royal Society of Medicine.

[8]  D. Drachman,et al.  If we live long enough, will we all be demented? , 1994, Neurology.

[9]  José Mira Mira,et al.  On the correspondence between objects and events for the diagnosis of situations in visual surveillance tasks , 2008, Pattern Recognit. Lett..

[10]  Boubakeur Boufama,et al.  Tracking Multiple People in the Context of Video Surveillance , 2007, ICIAR.

[11]  M V Baldelli,et al.  Evaluation of temporal and spatial disorientation in elderly patients with cognitive impairment. , 2002, Archives of gerontology and geriatrics. Supplement.

[12]  David Vernon,et al.  Cognitive Vision: the Case for Embodied Perception , 2005 .

[13]  Hans-Hellmut Nagel,et al.  Natural Language Texts for a Cognitive Vision System , 2002, ECAI.

[14]  S. Hoyer,et al.  A new psychometric test of attention-related behavior in rats; its validity in the aging process. , 1989, Archives of gerontology and geriatrics.

[15]  Ramakant Nevatia,et al.  VERL: An Ontology Framework for Representing and Annotating Video Events , 2005, IEEE Multim..

[16]  J. Saczynski,et al.  Delirium in elderly people , 2014, The Lancet.

[17]  Antonio Fernández-Caballero,et al.  Multi-agent system for knowledge-based event recognition and composition , 2011 .

[18]  F. Xavier Roca,et al.  Understanding dynamic scenes based on human sequence evaluation , 2009, Image Vis. Comput..

[19]  Rafael Martínez-Tomás,et al.  Event Detection and Fusion Model for Semantic Interpretation of Monitored Scenarios within ASIMS Architecture , 2011, IWINAC.

[20]  Juan Moreno García,et al.  Video sequence motion tracking by fuzzification techniques , 2010, Appl. Soft Comput..

[21]  Antonio Fernández-Caballero,et al.  Wireless Multisensory Interaction in an Intelligent Rehabilitation Environment , 2014, ISAmI.

[22]  Ana Jimenez-Vilchez,et al.  Study of confusion syndrome in patients admitted to a trauma unit: Why do elderly patients get disorientated? , 2004 .

[23]  François Brémond,et al.  Group behavior recognition with multiple cameras , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[24]  Ronald Poppe,et al.  A survey on vision-based human action recognition , 2010, Image Vis. Comput..

[25]  Hans-Hellmut Nagel,et al.  Cognitive visual tracking and camera control , 2012, Comput. Vis. Image Underst..

[26]  Hans-Hellmut Nagel,et al.  Image sequence evaluation: 30 years and still going strong , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[27]  P D Cleary,et al.  Delirium. The occurrence and persistence of symptoms among elderly hospitalized patients. , 1992, Archives of internal medicine.

[28]  Antonio Fernández-Caballero,et al.  Thermal-Infrared Pedestrian ROI Extraction through Thermal and Motion Information Fusion , 2014, Sensors.

[29]  Jake K. Aggarwal,et al.  Semantic Representation and Recognition of Continued and Recursive Human Activities , 2009, International Journal of Computer Vision.

[30]  Hans-Hellmut Nagel,et al.  Conceptual representations between video signals and natural language descriptions , 2008, Image Vis. Comput..

[31]  José Manuel Ferrández,et al.  Intelligent monitoring for people assistance and safety , 2014, Expert Syst. J. Knowl. Eng..

[32]  José Manuel Cuadra Troncoso,et al.  Smart Spaces and Monitoring Simulation , 2013, IWINAC.

[33]  David W. Bates,et al.  Confusion and delirium , 2009 .

[34]  Xingshe Zhou,et al.  Disorientation detection by mining GPS trajectories for cognitively-impaired elders , 2015, Pervasive Mob. Comput..