Activity Recognition and Abnormal Behaviour Detection with Recurrent Neural Networks

In this paper, we study the problem of activity recognition and abnormal behaviour detection for elderly people with dementia. Very few studies have attempted to address this problem presumably because of the lack of experimental data in the context of dementia care. In particular, the paper investigates three variants of Recurrent Neural Networks (RNNs): Vanilla RNNs (VRNN), Long Short Term RNNs (LSTM) and Gated Recurrent Unit RNNs (GRU). Here activity recognition is considered as a sequence labelling problem, while abnormal behaviour is flagged based on the deviation from normal patterns. To provide an adequate discussion of the performance of RNNs in this context, we compare them against the state-of-art methods such as Support Vector Machines (SVMs), Na¨ive Bayes (NB), Hidden Markov Models (HMMs), Hidden Semi-Markov Models (HSMM) and Conditional Random Fields (CRFs). The results obtained indicate that RNNs are competitive with those state-of-art methods. Moreover, the paper presents a methodology for generating synthetic data reflecting on some behaviours of people with dementia given the difficulty of obtaining real-world data.

[1]  Long Chen,et al.  Recurrent Neural Network for Human Activity Recognition in Smart Home , 2013 .

[2]  Ahmad Lotfi,et al.  Smart homes for the elderly dementia sufferers: identification and prediction of abnormal behaviour , 2012, J. Ambient Intell. Humaniz. Comput..

[3]  Patrick Olivier,et al.  Feature Learning for Activity Recognition in Ubiquitous Computing , 2011, IJCAI.

[4]  Nick C Fox,et al.  The Diagnosis of Mild Cognitive Impairment due to Alzheimer’s Disease: Recommendations from the National Institute on Aging-Alzheimer’s Association Workgroups on Diagnostic Guidelines for Alzheimer’s Disease , 2011 .

[5]  Claudio Bettini,et al.  Fine-grained recognition of abnormal behaviors for early detection of mild cognitive impairment , 2015, 2015 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[6]  Songhwai Oh,et al.  Human behavior prediction for smart homes using deep learning , 2013, 2013 IEEE RO-MAN.

[7]  Richard Walker,et al.  PD Disease State Assessment in Naturalistic Environments Using Deep Learning , 2015, AAAI.

[8]  Abdelhamid Bouchachia,et al.  Smart Homes Design for People with Dementia , 2015, 2015 International Conference on Intelligent Environments.

[9]  Xiaoli Li,et al.  Deep Convolutional Neural Networks on Multichannel Time Series for Human Activity Recognition , 2015, IJCAI.

[10]  Leon Bieber,et al.  Neurological rehabilitation. , 1992, Current opinion in neurology and neurosurgery.

[11]  Yoshua Bengio,et al.  On the Properties of Neural Machine Translation: Encoder–Decoder Approaches , 2014, SSST@EMNLP.

[12]  Chen Hu,et al.  Recognizing human activity in smart home using deep learning algorithm , 2014, Proceedings of the 33rd Chinese Control Conference.

[13]  Sung-Bae Cho,et al.  Evaluation of Deep Convolutional Neural Network Architectures for Human Activity Recognition with Smartphone Sensors , 2015 .

[14]  Miguel A. Labrador,et al.  A mobile platform for real-time human activity recognition , 2012, 2012 IEEE Consumer Communications and Networking Conference (CCNC).

[15]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.

[16]  Diane J. Cook,et al.  Smart home-based longitudinal functional assessment , 2014, UbiComp Adjunct.

[17]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[18]  Gwenn Englebienne,et al.  Human activity recognition from wireless sensor network data: benchmark and software , 2011 .

[19]  Gregory Faraut,et al.  Activity Discovery and Detection of Behavioral Deviations of an Inhabitant From Binary Sensors , 2015, IEEE Transactions on Automation Science and Engineering.

[20]  Thomas Kirste,et al.  Detecting the effect of Alzheimer's disease on everyday motion behavior. , 2013, Journal of Alzheimer's disease : JAD.

[21]  Mark W. Newman,et al.  Automatic Assessment of Cognitive Impairment through Electronic Observation of Object Usage , 2010, Pervasive.

[22]  Luc Cluitmans,et al.  Advancing from offline to online activity recognition with wearable sensors , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[23]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[24]  Claudio Bettini,et al.  From lab to life: Fine-grained behavior monitoring in the elderly's home , 2015, 2015 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops).

[25]  Thomas Plötz,et al.  Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables , 2016, IJCAI.

[26]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[27]  Bo Yu,et al.  Convolutional Neural Networks for human activity recognition using mobile sensors , 2014, 6th International Conference on Mobile Computing, Applications and Services.

[28]  Prafulla N. Dawadi,et al.  An approach to cognitive assessment in smart home , 2011, DMMH '11.