SmartFABER: Recognizing fine-grained abnormal behaviors for early detection of mild cognitive impairment

OBJECTIVE In an ageing world population more citizens are at risk of cognitive impairment, with negative consequences on their ability of independent living, quality of life and sustainability of healthcare systems. Cognitive neuroscience researchers have identified behavioral anomalies that are significant indicators of cognitive decline. A general goal is the design of innovative methods and tools for continuously monitoring the functional abilities of the seniors at risk and reporting the behavioral anomalies to the clinicians. SmartFABER is a pervasive system targeting this objective. METHODS A non-intrusive sensor network continuously acquires data about the interaction of the senior with the home environment during daily activities. A novel hybrid statistical and knowledge-based technique is used to analyses this data and detect the behavioral anomalies, whose history is presented through a dashboard to the clinicians. Differently from related works, SmartFABER can detect abnormal behaviors at a fine-grained level. RESULTS We have fully implemented the system and evaluated it using real datasets, partly generated by performing activities in a smart home laboratory, and partly acquired during several months of monitoring of the instrumented home of a senior diagnosed with MCI. Experimental results, including comparisons with other activity recognition techniques, show the effectiveness of SmartFABER in terms of recognition rates.

[1]  Michel C. A. Klein,et al.  Intelligent mobile support for therapy adherence and behavior change , 2014, J. Biomed. Informatics.

[2]  Thanos G. Stavropoulos,et al.  A Sensor-Based Framework to Support Clinicians in Dementia Assessment: The Results of a Pilot Study , 2015, ISAmI.

[3]  Diane J. Cook,et al.  COM: A method for mining and monitoring human activity patterns in home-based health monitoring systems , 2013, ACM Trans. Intell. Syst. Technol..

[4]  Brian Lawlor,et al.  Rating scales in old age psychiatry , 2002, British Journal of Psychiatry.

[5]  A. Greco,et al.  Managing active and healthy aging with use of caring service robots , 2015 .

[6]  Filip De Turck,et al.  Towards a social and context-aware multi-sensor fall detection and risk assessment platform , 2015, Comput. Biol. Medicine.

[7]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[8]  Diane J. Cook,et al.  Activity recognition on streaming sensor data , 2014, Pervasive Mob. Comput..

[9]  Blake Hannaford,et al.  A Hybrid Discriminative/Generative Approach for Modeling Human Activities , 2005, IJCAI.

[10]  C. Jack,et al.  Mild cognitive impairment – beyond controversies, towards a consensus: report of the International Working Group on Mild Cognitive Impairment , 2004, Journal of internal medicine.

[11]  Jae Won Chung,et al.  Impairment of Instrumental Activities of Daily Living in Patients with Mild Cognitive Impairment , 2009, Psychiatry investigation.

[12]  Jacques Demongeot,et al.  A system for automatic measurement of circadian activity deviations in telemedicine , 2002, IEEE Transactions on Biomedical Engineering.

[13]  Catherine Garbay,et al.  Learning recurrent behaviors from heterogeneous multivariate time-series , 2007, Artif. Intell. Medicine.

[14]  Oliver Amftand Recognition of dietary activity events using on-body sensors , 2008 .

[15]  Tao Gu,et al.  Object relevance weight pattern mining for activity recognition and segmentation , 2010, Pervasive Mob. Comput..

[16]  Majid Sarrafzadeh,et al.  Monitoring eating habits using a piezoelectric sensor-based necklace , 2015, Comput. Biol. Medicine.

[17]  Andrea Omicini,et al.  Multi-paradigm Java-Prolog integration in tuProlog , 2005, Sci. Comput. Program..

[18]  Orith Toledo-Ronen,et al.  Voice-based sadness and anger recognition with cross-corpora evaluation , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[19]  Miia Kivipelto,et al.  Introduction: Mild cognitive impairment: beyond controversies, towards a consensus , 2004 .

[20]  Guang-Zhong Yang,et al.  Ear-worn body sensor network device: an objective tool for functional postoperative home recovery monitoring , 2011, J. Am. Medical Informatics Assoc..

[21]  Gwenn Englebienne,et al.  Accurate activity recognition in a home setting , 2008, UbiComp.

[22]  Prafulla N Dawadi,et al.  Automated assessment of cognitive health using smart home technologies. , 2013, Technology and health care : official journal of the European Society for Engineering and Medicine.

[23]  Simon A. Dobson,et al.  Situation identification techniques in pervasive computing: A review , 2012, Pervasive Mob. Comput..

[24]  Vikramaditya R. Jakkula,et al.  Anomaly Detection Using Temporal Data Mining in a Smart Home Environment , 2008, Methods of Information in Medicine.

[25]  Marjorie Skubic,et al.  Testing Classifiers for Embedded Health Assessment , 2012, ICOST.

[26]  Rita Paradiso,et al.  A wearable health care system based on knitted integrated sensors , 2005, IEEE Transactions on Information Technology in Biomedicine.

[27]  Claudio Bettini,et al.  Experience report: ontological reasoning for context-aware Internet services , 2006, Fourth Annual IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOMW'06).

[28]  M. Schmitter-Edgecombe,et al.  Applications of Technology in Neuropsychological Assessment , 2013, The Clinical neuropsychologist.

[29]  Chris D. Nugent,et al.  Dynamic similarity-based activity detection and recognition within smart homes , 2012, Int. J. Pervasive Comput. Commun..

[30]  Prafulla N. Dawadi,et al.  An approach to cognitive assessment in smart home , 2011, DMMH '11.

[31]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[32]  Oya Beyan,et al.  Robot-assisted care for elderly with dementia: is there a potential for genuine end-user empowerment? , 2015 .

[33]  Georgios Meditskos,et al.  Knowledge-Driven Activity Recognition and Segmentation Using Context Connections , 2014, International Semantic Web Conference.

[34]  Tania Giovannetti,et al.  Characterization of Everyday Functioning in Mild Cognitive Impairment: A Direct Assessment Approach , 2008, Dementia and Geriatric Cognitive Disorders.

[35]  Maureen Schmitter-Edgecombe,et al.  Automated Cognitive Health Assessment Using Smart Home Monitoring of Complex Tasks , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[36]  J. Robine,et al.  Ageing in the European Union , 2013, The Lancet.

[37]  L. Rabiner,et al.  An introduction to hidden Markov models , 1986, IEEE ASSP Magazine.

[38]  Claudio Bettini,et al.  Fine-grained recognition of abnormal behaviors for early detection of mild cognitive impairment , 2015, 2015 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[39]  Claudio Bettini,et al.  From lab to life: Fine-grained behavior monitoring in the elderly's home , 2015, 2015 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops).

[40]  Diane J Cook,et al.  Assessing the Quality of Activities in a Smart Environment , 2009, Methods of Information in Medicine.

[41]  P. Robert,et al.  Alzheimer's patient activity assessment using different sensors , 2012 .

[42]  Adriana M. Seelye,et al.  Naturalistic Assessment of Everyday Activities and Prompting Technologies in Mild Cognitive Impairment , 2013, Journal of the International Neuropsychological Society.

[43]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[44]  Boris Motik,et al.  OWL 2: The next step for OWL , 2008, J. Web Semant..

[45]  Heiner Stuckenschmidt,et al.  A probabilistic ontological framework for the recognition of multilevel human activities , 2013, UbiComp.

[46]  Liming Chen,et al.  Dynamic sensor data segmentation for real-time knowledge-driven activity recognition , 2014, Pervasive Mob. Comput..

[47]  Manuel Campos,et al.  Spatiotemporal data visualisation for homecare monitoring of elderly people , 2015, Artif. Intell. Medicine.

[48]  Gerd Brewka,et al.  Artificial intelligence - a modern approach by Stuart Russell and Peter Norvig, Prentice Hall. Series in Artificial Intelligence, Englewood Cliffs, NJ , 1996, The Knowledge Engineering Review.

[49]  Matthew Richardson,et al.  Markov logic networks , 2006, Machine Learning.

[50]  Myrna F. Schwartz,et al.  The Naturalistic Action Test: A standardised assessment for everyday action impairment , 2002 .

[51]  Andre Gustavo Adami,et al.  Unobtrusive assessment of activity patterns associated with mild cognitive impairment , 2008, Alzheimer's & Dementia.

[52]  Tania Giovannetti,et al.  A New Approach to the Characterization of Subtle Errors in Everyday Action: Implications for Mild Cognitive Impairment , 2014, The Clinical neuropsychologist.

[53]  P. Robert,et al.  Detection of activities of daily living impairment in Alzheimer’s disease and mild cognitive impairment using information and communication technology , 2012, Clinical interventions in aging.

[54]  Yiannis Kompatsiaris,et al.  Evaluation of speech-based protocol for detection of early-stage dementia , 2013, INTERSPEECH.