Online activity recognition and daily habit modeling for solitary elderly through indoor position-based stigmergy

Abstract This paper concerns the issue of monitoring elderly behavior in the context of ambient assisted living (AAL). Under the framework of online daily habit modeling (ODHM), we employ the emergent representation for activities of daily living (ADLs) with position-based stigmergy, and then combine it with convolution neural networks (CNNs) to accomplish the tasks of recognizing ADLs. In addition, we propose a new paradigm of activity summarization with the robustness to break interruptions. Radio tomographic imaging (RTI) is promoted as a simple yet flexible way of facilitating the required position-based stigmergy. Such position-based AAL systems can benefit the advantages of having no need any sophisticated domain models in analyzing and understanding ADLs while no burden training is involved in ODHM. Moreover, the emergent based data aggregation and deep learning of CNN together allow the recognition of ADLs at a fine-grained level, which contributes to the performance improvement of ODHM. Experimental results demonstrate the effectiveness of the proposed approach.

[1]  Kristof Van Laerhoven,et al.  myHealthAssistant: a phone-based body sensor network that captures the wearer's exercises throughout the day , 2011, BODYNETS.

[2]  Neal Patwari,et al.  Radio Tomographic Imaging with Wireless Networks , 2010, IEEE Transactions on Mobile Computing.

[3]  Brett J. Borghetti,et al.  A Review of Anomaly Detection in Automated Surveillance , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[4]  Kenneth Hsu,et al.  Reliable and Secure Body fall Detection Algorithm in a Wireless Mesh Network , 2013, BODYNETS.

[5]  Nader Karimi,et al.  Automatic Monocular System for Human Fall Detection Based on Variations in Silhouette Area , 2013, IEEE Transactions on Biomedical Engineering.

[6]  Hong Cheng,et al.  Real world activity summary for senior home monitoring , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[7]  Paolo Barsocchi,et al.  Monitoring elderly behavior via indoor position-based stigmergy , 2015, Pervasive Mob. Comput..

[8]  Yi Yang,et al.  Multi-Class Active Learning by Uncertainty Sampling with Diversity Maximization , 2015, International Journal of Computer Vision.

[9]  Mihail Popescu,et al.  A new illness recognition framework using frequent temporal pattern mining , 2014, UbiComp Adjunct.

[10]  Xiang Chen,et al.  A Framework for Daily Activity Monitoring and Fall Detection Based on Surface Electromyography and Accelerometer Signals , 2013, IEEE Journal of Biomedical and Health Informatics.

[11]  Gwenn Englebienne,et al.  Behavior analysis of elderly using topic models , 2014, Pervasive Mob. Comput..

[12]  Ahmed H. Tewfik,et al.  A feature combination approach for the detection of early morning bathroom activities with wireless sensors , 2007, HealthNet '07.

[13]  Norbert Wehn,et al.  Monitoring household activities and user location with a cheap, unobtrusive thermal sensor array , 2014, UbiComp.

[14]  Vadim V. Strijov,et al.  Human activity recognition using quasiperiodic time series collected from a single tri-axial accelerometer , 2016, Multimedia Tools and Applications.

[15]  Nadia Mana,et al.  What is happening now? Detection of activities of daily living from simple visual features , 2010, Personal and Ubiquitous Computing.

[16]  Alanson P. Sample,et al.  IDSense: A Human Object Interaction Detection System Based on Passive UHF RFID , 2015, CHI.

[17]  Yunjian Ge,et al.  HMM-Based Human Fall Detection and Prediction Method Using Tri-Axial Accelerometer , 2013, IEEE Sensors Journal.

[18]  Tetsuya Nakamura,et al.  Behavior-based stigmergic navigation , 2010, UbiComp '10 Adjunct.

[19]  Diane J. Cook,et al.  COM: A method for mining and monitoring human activity patterns in home-based health monitoring systems , 2013, ACM Trans. Intell. Syst. Technol..

[20]  John Herbert,et al.  Context-aware hybrid reasoning framework for pervasive healthcare , 2014, Personal and Ubiquitous Computing.

[21]  Chunyan Miao,et al.  Towards online and personalized daily activity recognition, habit modeling, and anomaly detection for the solitary elderly through unobtrusive sensing , 2016, Multimedia Tools and Applications.

[22]  Tamer Nadeem,et al.  Wearable Sensing Framework for Human Activity Monitoring , 2015, WearSys '15.

[23]  Yiannis Kompatsiaris,et al.  Activity detection and recognition of daily living events , 2013, MIIRH '13.

[24]  Carmen C. Y. Poon,et al.  Unobtrusive Sensing and Wearable Devices for Health Informatics , 2014, IEEE Transactions on Biomedical Engineering.

[25]  Charles Consel,et al.  Verification of daily activities of older adults: a simple, non-intrusive, low-cost approach , 2014, ASSETS.

[26]  Francesco Marcelloni,et al.  Autonomic tracing of production processes with mobile and agent-based computing , 2011, Inf. Sci..

[27]  Ahmad Lotfi,et al.  Smart homes for the elderly dementia sufferers: identification and prediction of abnormal behaviour , 2012, J. Ambient Intell. Humaniz. Comput..

[28]  Araceli Sanchis,et al.  Sensor-based Bayesian detection of anomalous living patterns in a home setting , 2014, Personal and Ubiquitous Computing.

[29]  Neal Patwari,et al.  Correlated link shadow fading in multi-hop wireless networks , 2008, IEEE Transactions on Wireless Communications.

[30]  Nicu Sebe,et al.  Egocentric Daily Activity Recognition via Multitask Clustering , 2015, IEEE Transactions on Image Processing.

[31]  Kent Larson,et al.  Activity Recognition in the Home Using Simple and Ubiquitous Sensors , 2004, Pervasive.

[32]  Ahmed Nait Aicha,et al.  How lonely is your grandma?: detecting the visits to assisted living elderly from wireless sensor network data , 2013, UbiComp.

[33]  Byung-Seo Kim,et al.  Smart Solutions in Elderly Care Facilities with RFID System and Its Integration with Wireless Sensor Networks , 2014, Int. J. Distributed Sens. Networks.

[34]  Susan Elias,et al.  Hierarchical activity recognition for dementia care using Markov Logic Network , 2014, Personal and Ubiquitous Computing.