Modeling the behavior of persons with mild cognitive impairment or Alzheimer’s for intelligent environment simulation

Intelligent environments may improve the independence and quality of life of persons with mild cognitive impairment (MCI) or Alzheimer’s disease (AD) through their ability to automatically provide assistance or guidance. In order to deploy these systems in this category of the population, it is necessary to be able to carry out validation and experiments to improve efficiency, safety, user experience and reduce installation costs. Unfortunately, this type of experiment can be difficult to perform because of the difficulty in recruiting candidates and accessing adequate intelligent environments. These problems could be partially offset with simulators. These tools can be used to simulate the behavior of an intelligent environment and its occupants in order to generate data, or to observe and evaluate their behavior. However, to design systems for populations suffering from MCI or AD, it is necessary that the simulator be able to emulate the behavior of these persons. In this paper, two approaches to simulate and generate sequences of actions containing errors usually committed by persons with this type of disease are proposed. Those approaches aim to be simple to use and both are based on the use of behavior trees. The first one consists in adding nodes to a behavior tree to simulate errors with their specific probabilities. The second approach consists in defining an interval to bind the number of errors that can be inserted through the error injection algorithm. We also present the results of the experiments carried out to evaluate these approaches. For the first experiment, several simulations were conducted and were recorded in videos. These videos were analyzed by specialists in cognitive disorders who diagnosed the avatar of these videos. The second experiment aimed at comparing the two approaches together. To do so, several action sequences were generated. The results show that our model is able to generate healthy, MCI and Alzheimer’s behaviors. The results also show that the second approach facilitates the generation of a desired number of errors.

[1]  Jacques Ferber,et al.  Les Systèmes multi-agents: vers une intelligence collective , 1995 .

[2]  Nathalie Bier,et al.  Performance-based Tools for Assessing Functional Performance in Individuals with Mild Cognitive Impairment , 2015 .

[3]  Barbara Messing,et al.  An Introduction to MultiAgent Systems , 2002, Künstliche Intell..

[4]  Audrey Serna,et al.  Modeling the progression of Alzheimer’s disease for cognitive assistance in smart homes , 2007, User Modeling and User-Adapted Interaction.

[5]  Lawrence B. Holder,et al.  Conditional random fields for activity recognition in smart environments , 2010, IHI.

[6]  Jesse Hoey,et al.  Sensor-Based Activity Recognition , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[7]  K. J. Miller,et al.  Smart-Home Technologies to Assist Older People to Live Well at Home , 2013 .

[8]  Diane J. Cook,et al.  Automatic assessment of functional health decline in older adults based on smart home data , 2018, J. Biomed. Informatics.

[9]  Amjad Anvari-Moghaddam,et al.  Optimal Smart Home Energy Management Considering Energy Saving and a Comfortable Lifestyle , 2016, IEEE Transactions on Smart Grid.

[10]  Dan Yang,et al.  RiSH: A robot-integrated smart home for elderly care , 2018, Robotics Auton. Syst..

[11]  C. Crawford Chris Crawford on Interactive Storytelling , 2004 .

[12]  G. Camilleri,et al.  A generic formal plan recognition theory , 1999, Proceedings 1999 International Conference on Information Intelligence and Systems (Cat. No.PR00446).

[13]  Lee McCauley,et al.  IDA: a cognitive agent architecture , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[14]  Gerhard Leitner,et al.  The Future Home is Wise, Not Smart , 2015, Computer Supported Cooperative Work.

[15]  J. Morris,et al.  The diagnosis of dementia due to Alzheimer’s disease: Recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer's disease , 2011, Alzheimer's & Dementia.

[16]  Roger Nkambou,et al.  Decision-Making in Cognitive Tutoring Systems , 2010, Advances in Intelligent Tutoring Systems.

[17]  Fabio Paternò,et al.  ConcurTaskTrees: A Diagrammatic Notation for Specifying Task Models , 1997, INTERACT.

[18]  Janet Wesson,et al.  A Smart Home Simulation Tool to Support the Recognition of Activities of Daily Living , 2019, SAICSIT '19.

[19]  Stan Franklin,et al.  THE LIDA ARCHITECTURE: ADDING NEW MODES OF LEARNING TO AN INTELLIGENT, AUTONOMOUS, SOFTWARE AGENT , 2006 .

[20]  Sean Luke,et al.  MASON: A Multiagent Simulation Environment , 2005, Simul..

[21]  Ahmad Lotfi,et al.  Smart homes for the elderly dementia sufferers: identification and prediction of abnormal behaviour , 2012, J. Ambient Intell. Humaniz. Comput..

[22]  Bela Pataki,et al.  Multilevel simulation of daily activities: Why and how? , 2013, 2013 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA).

[23]  Petter Ögren,et al.  Towards a unified behavior trees framework for robot control , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Stefan Saroiu,et al.  Home automation in the wild: challenges and opportunities , 2011, CHI.

[25]  Abdelsalam Helal,et al.  Activity Playback Modeling for Smart Home Simulation , 2015, ICOST.

[26]  G. Humphreys,et al.  Disordered action schema and action disorganisation syndrome , 1998 .

[27]  Daniel Jackson,et al.  Relational Approach to Knowledge Engineering for POMDP-based Assistance Systems as a Translation of a Psychological Model , 2012, Int. J. Approx. Reason..

[28]  Howard J. Hamilton,et al.  Behavior Trees for Modelling Artificial Intelligence in Games: A Tutorial , 2017, The Computer Games Journal.

[29]  Julie A. Adams,et al.  Multiagent Systems: A Modern Approach to Distributed Artificial Intelligence , 2001, AI Mag..

[30]  Michael Schneider,et al.  Resource-aware plan recognition in instrumented environments , 2010 .

[31]  D. Pavithra,et al.  IoT based monitoring and control system for home automation , 2015, 2015 Global Conference on Communication Technologies (GCCT).

[32]  Sylvain Giroux,et al.  Integrating an Ambient Assisted Living monitoring system into clinical decision-making in home care: An embedded case study , 2020, Gerontechnology.

[33]  Mohamed Sedky,et al.  OpenSHS: Open Smart Home Simulator , 2017, Sensors.

[34]  Michael E. Bratman,et al.  Intention, Plans, and Practical Reason , 1991 .

[35]  Bruno Bouchard,et al.  Activity Recognition Through Complex Event Processing: First Findings , 2016, AAAI Workshop: Artificial Intelligence Applied to Assistive Technologies and Smart Environments.

[36]  Diego M. Castro,et al.  Behavioral symptoms related to cognitive impairment , 2013, Neuropsychiatric disease and treatment.

[37]  Mohamed Sedky,et al.  SIMADL: Simulated Activities of Daily Living Dataset , 2018, Data.

[38]  John R. Anderson,et al.  Rules of the Mind , 1993 .

[39]  Robert P. Goldman,et al.  A Bayesian Model of Plan Recognition , 1993, Artif. Intell..

[40]  Jesse Hoey,et al.  Activity Recognition in Pervasive Intelligent Environments , 2011 .

[41]  Emiliano Sisinni,et al.  Remote and non-invasive monitoring of elderly in a smart city context , 2018, 2018 IEEE Sensors Applications Symposium (SAS).

[42]  Fabio Paternò,et al.  ConcurTaskTrees: An Engineered Notation for Task Models , 2003 .

[43]  Kyungeun Cho,et al.  Context activity selection and scheduling in context-driven simulation , 2014, SpringSim.

[44]  Tania Giovannetti,et al.  Characterization of Everyday Functioning in Mild Cognitive Impairment: A Direct Assessment Approach , 2008, Dementia and Geriatric Cognitive Disorders.

[45]  Kevin Bouchard,et al.  Modeling Human Activities Using Behaviour Trees in Smart Homes , 2018, PETRA.

[46]  Juan A. Botía Blaya,et al.  Validating ambient intelligence based ubiquitous computing systems by means of artificial societies , 2013, Inf. Sci..

[47]  Wayne Wobcke,et al.  Two Logical Theories of Plan Recognition , 2002, J. Log. Comput..

[48]  Henry A. Kautz,et al.  Fine-grained activity recognition by aggregating abstract object usage , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[49]  Maureen Schmitter-Edgecombe,et al.  Assessment of functional change and cognitive correlates in the progression from healthy cognitive aging to dementia. , 2014, Neuropsychology.

[50]  Kyungeun Cho,et al.  Persim 3D: Context-Driven Simulation and Modeling of Human Activities in Smart Spaces , 2015, IEEE Transactions on Automation Science and Engineering.

[51]  R. Goldman,et al.  Partial Observability and Probabilistic Plan/Goal Recognition , 2005 .

[52]  Chris D. Nugent,et al.  Simulation of Smart Home Activity Datasets , 2015, Sensors.

[53]  C. Caltagirone,et al.  Alzheimer'S disease (ad) and mild cognitive impairment (mci) patients are characterized by increased bdnf serum levels , 2009, Alzheimer's & Dementia.

[54]  Yunsi Fei,et al.  Smart Home in Smart Microgrid: A Cost-Effective Energy Ecosystem With Intelligent Hierarchical Agents , 2015, IEEE Transactions on Smart Grid.

[55]  Peter Mariën,et al.  Behavioral syndromes in mild cognitive impairment and Alzheimer's disease. , 2013, Journal of Alzheimer's disease : JAD.

[56]  P. C. Malshe What is this interaction? , 1994, The Journal of the Association of Physicians of India.

[57]  Abdenour Bouzouane,et al.  The Virtual Environment for Rapid Prototyping of the Intelligent Environment , 2017, Sensors.