Towards online and personalized daily activity recognition, habit modeling, and anomaly detection for the solitary elderly through unobtrusive sensing

Rapid population aging and advances in sensing technologies motivate the development of unobtrusive healthcare systems, designed to unobtrusively collect an elderly’s personalized information of daily living and help him actively enjoy a healthy lifestyle. Existing studies towards this goal typically focus on recognition of activities of daily living (ADLs) and abnormal behavior detection. However, the applicability of these approaches is often limited by an offline analysis strategy, complex parameter tuning, obtrusive data collection, and a need for training data. To overcome these shortcomings, this paper presents a novel framework, named the online daily habit modeling and anomaly detection (ODHMAD) model, for the real-time personalized ADL recognition, habit modeling, and anomaly detection for the solitary elderly. In contrast to most existing studies which consider activity recognition and abnormal behavior detection separately, ODHMAD links both in a system. Specifically, ODHMAD performs online recognition of the elderly’s daily activities and dynamically models the elderly’s daily habit. In this way, ODHMAD recognizes the personalized abnormal behavior of an elderly by detecting anomalies in his learnt daily habit. The developed online activity recognition (OAR) algorithm determines the occurrence of activities by modeling the activation status of sensors. It has advantages of online learning, light parameter tuning, and no training data required. Moreover, OAR is able to obtain details of the detected activities. Experimental results demonstrate the effectiveness of the proposed OAR model for online activity recognition in terms of precision, false alarm rate, and miss detection rate.

[1]  Yi Yang,et al.  Complex Event Detection using Semantic Saliency and Nearly-Isotonic SVM , 2015, ICML.

[2]  Ahmad Lotfi,et al.  Smart homes for the elderly dementia sufferers: identification and prediction of abnormal behaviour , 2012, J. Ambient Intell. Humaniz. Comput..

[3]  Ricardo Chavarriaga,et al.  Benchmarking classification techniques using the Opportunity human activity dataset , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[4]  Araceli Sanchis,et al.  Sensor-based Bayesian detection of anomalous living patterns in a home setting , 2014, Personal and Ubiquitous Computing.

[5]  Diane J. Cook,et al.  COM: A method for mining and monitoring human activity patterns in home-based health monitoring systems , 2013, ACM Trans. Intell. Syst. Technol..

[6]  Nicu Sebe,et al.  Egocentric Daily Activity Recognition via Multitask Clustering , 2015, IEEE Transactions on Image Processing.

[7]  Yang Zhongyuan,et al.  Detection Elder Abnormal Activities by using Omni-directional Vision Sensor: Activity Data Collection and Modeling , 2006, 2006 SICE-ICASE International Joint Conference.

[8]  Elena I. Gaura,et al.  Data set for fall events and daily activities from inertial sensors , 2015, MMSys.

[9]  Kent Larson,et al.  Activity Recognition in the Home Using Simple and Ubiquitous Sensors , 2004, Pervasive.

[10]  Nadia Mana,et al.  What is happening now? Detection of activities of daily living from simple visual features , 2010, Personal and Ubiquitous Computing.

[11]  Alanson P. Sample,et al.  IDSense: A Human Object Interaction Detection System Based on Passive UHF RFID , 2015, CHI.

[12]  Lasitha Piyathilaka,et al.  Gaussian mixture based HMM for human daily activity recognition using 3D skeleton features , 2013, 2013 IEEE 8th Conference on Industrial Electronics and Applications (ICIEA).

[13]  John Herbert,et al.  Context-aware hybrid reasoning framework for pervasive healthcare , 2014, Personal and Ubiquitous Computing.

[14]  Kristof Van Laerhoven,et al.  myHealthAssistant: a phone-based body sensor network that captures the wearer's exercises throughout the day , 2011, BODYNETS.

[15]  Brett J. Borghetti,et al.  A Review of Anomaly Detection in Automated Surveillance , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[16]  O. Ojetola,et al.  Detection of human falls using wearable sensors , 2013 .

[17]  Hong Cheng,et al.  Real world activity summary for senior home monitoring , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[18]  Vangelis Metsis,et al.  Abnormal human behavioral pattern detection in assisted living environments , 2010, PETRA '10.

[19]  Dong-Soo Kwon,et al.  Unsupervised clustering for abnormality detection based on the tri-axial accelerometer , 2009, 2009 ICCAS-SICE.

[20]  R. Bajcsy,et al.  Wearable Sensors for Reliable Fall Detection , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[21]  H. Zha,et al.  A fully online and unsupervised system for large and high-density area surveillance: Tracking, semantic scene learning and abnormality detection , 2013, TIST.

[22]  Yi-Liang Zhao,et al.  Bridging the Vocabulary Gap between Health Seekers and Healthcare Knowledge , 2015, IEEE Transactions on Knowledge and Data Engineering.

[23]  Nader Karimi,et al.  Automatic Monocular System for Human Fall Detection Based on Variations in Silhouette Area , 2013, IEEE Transactions on Biomedical Engineering.

[24]  Mihail Popescu,et al.  A new illness recognition framework using frequent temporal pattern mining , 2014, UbiComp Adjunct.

[25]  Xiang Chen,et al.  A Framework for Daily Activity Monitoring and Fall Detection Based on Surface Electromyography and Accelerometer Signals , 2013, IEEE Journal of Biomedical and Health Informatics.

[26]  Nicu Sebe,et al.  Multi-task linear discriminant analysis for multi-view action recognition , 2013, 2013 IEEE International Conference on Image Processing.

[27]  Shehroz S. Khan,et al.  Towards the detection of unusual temporal events during activities using HMMs , 2012, UbiComp '12.

[28]  Tao Li,et al.  WenZher: comprehensive vertical search for healthcare domain , 2014, SIGIR.

[29]  Ahmed H. Tewfik,et al.  A feature combination approach for the detection of early morning bathroom activities with wireless sensors , 2007, HealthNet '07.

[30]  Kenneth Hsu,et al.  Reliable and Secure Body fall Detection Algorithm in a Wireless Mesh Network , 2013, BODYNETS.

[31]  Ahmed Nait Aicha,et al.  How lonely is your grandma?: detecting the visits to assisted living elderly from wireless sensor network data , 2013, UbiComp.

[32]  Tamer Nadeem,et al.  Wearable Sensing Framework for Human Activity Monitoring , 2015, WearSys '15.

[33]  Susan Elias,et al.  Hierarchical activity recognition for dementia care using Markov Logic Network , 2014, Personal and Ubiquitous Computing.

[34]  Yunjian Ge,et al.  HMM-Based Human Fall Detection and Prediction Method Using Tri-Axial Accelerometer , 2013, IEEE Sensors Journal.

[35]  Vadim V. Strijov,et al.  Human activity recognition using quasiperiodic time series collected from a single tri-axial accelerometer , 2016, Multimedia Tools and Applications.

[36]  Qiang Yang,et al.  Sensor-Based Abnormal Human-Activity Detection , 2008, IEEE Transactions on Knowledge and Data Engineering.

[37]  Meng Wang,et al.  Disease Inference from Health-Related Questions via Sparse Deep Learning , 2015, IEEE Transactions on Knowledge and Data Engineering.

[38]  Bart Selman,et al.  Unstructured human activity detection from RGBD images , 2011, 2012 IEEE International Conference on Robotics and Automation.

[39]  Gang Zhou,et al.  Accurate, Fast Fall Detection Using Gyroscopes and Accelerometer-Derived Posture Information , 2009, 2009 Sixth International Workshop on Wearable and Implantable Body Sensor Networks.

[40]  Yiannis Kompatsiaris,et al.  Activity Detection and Recognition of Daily Living Events , 2015, Health Monitoring and Personalized Feedback using Multimedia Data.

[41]  Yi Yang,et al.  Beyond Doctors: Future Health Prediction from Multimedia and Multimodal Observations , 2015, ACM Multimedia.

[42]  Carmen C. Y. Poon,et al.  Unobtrusive Sensing and Wearable Devices for Health Informatics , 2014, IEEE Transactions on Biomedical Engineering.

[43]  Charles Consel,et al.  Verification of daily activities of older adults: a simple, non-intrusive, low-cost approach , 2014, ASSETS.

[44]  Alex Mihailidis,et al.  A Survey on Ambient-Assisted Living Tools for Older Adults , 2013, IEEE Journal of Biomedical and Health Informatics.

[45]  M.H. Ang,et al.  Detection of activities for daily life surveillance: Eating and drinking , 2008, HealthCom 2008 - 10th International Conference on e-health Networking, Applications and Services.

[46]  Norbert Wehn,et al.  Monitoring household activities and user location with a cheap, unobtrusive thermal sensor array , 2014, UbiComp.

[47]  Ricardo Chavarriaga,et al.  Ensemble creation and reconfiguration for activity recognition: An information theoretic approach , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[48]  Yi Yang,et al.  Multi-Class Active Learning by Uncertainty Sampling with Diversity Maximization , 2015, International Journal of Computer Vision.

[49]  Alex Pentland,et al.  Daily Stress Recognition from Mobile Phone Data, Weather Conditions and Individual Traits , 2014, ACM Multimedia.