Evaluation of Three State-of-the-Art Classifiers for Recognition of Activities of Daily Living from Smart Home Ambient Data

Smart homes for the aging population have recently started attracting the attention of the research community. The “health state” of smart homes is comprised of many different levels; starting with the physical health of citizens, it also includes longer-term health norms and outcomes, as well as the arena of positive behavior changes. One of the problems of interest is to monitor the activities of daily living (ADL) of the elderly, aiming at their protection and well-being. For this purpose, we installed passive infrared (PIR) sensors to detect motion in a specific area inside a smart apartment and used them to collect a set of ADL. In a novel approach, we describe a technology that allows the ground truth collected in one smart home to train activity recognition systems for other smart homes. We asked the users to label all instances of all ADL only once and subsequently applied data mining techniques to cluster in-home sensor firings. Each cluster would therefore represent the instances of the same activity. Once the clusters were associated to their corresponding activities, our system was able to recognize future activities. To improve the activity recognition accuracy, our system preprocessed raw sensor data by identifying overlapping activities. To evaluate the recognition performance from a 200-day dataset, we implemented three different active learning classification algorithms and compared their performance: naive Bayesian (NB), support vector machine (SVM) and random forest (RF). Based on our results, the RF classifier recognized activities with an average specificity of 96.53%, a sensitivity of 68.49%, a precision of 74.41% and an F-measure of 71.33%, outperforming both the NB and SVM classifiers. Further clustering markedly improved the results of the RF classifier. An activity recognition system based on PIR sensors in conjunction with a clustering classification approach was able to detect ADL from datasets collected from different homes. Thus, our PIR-based smart home technology could improve care and provide valuable information to better understand the functioning of our societies, as well as to inform both individual and collective action in a smart city scenario.

[1]  Araceli Sanchis,et al.  Activity Recognition Using Hybrid Generative/Discriminative Models on Home Environments Using Binary Sensors , 2013, Sensors.

[2]  Ying Zhang,et al.  SensCare: Semi-automatic Activity Summarization System for Elderly Care , 2011, MobiCASE.

[3]  S. Katz Studies of illness in the aged , 1963 .

[4]  T. Nef,et al.  A Web-Based Non-Intrusive Ambient System to Measure and Classify Activities of Daily Living , 2014, Journal of medical Internet research.

[5]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[6]  Daijin Kim,et al.  Depth map-based human activity tracking and recognition using body joints features and Self-Organized Map , 2014, Fifth International Conference on Computing, Communications and Networking Technologies (ICCCNT).

[7]  Gwenn Englebienne,et al.  Human activity recognition from wireless sensor network data: benchmark and software , 2011 .

[8]  T. Bayes An essay towards solving a problem in the doctrine of chances , 2003 .

[9]  Cem Ersoy,et al.  Effective Performance Metrics for Evaluating Activity Recognition Methods , 2011, ARCS.

[10]  Thorsten Meinl,et al.  KNIME: The Konstanz Information Miner , 2007, GfKl.

[11]  Yoshiharu Yonezawa,et al.  A daily living activity remote monitoring system for solitary elderly people , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[12]  Hajime Takechi,et al.  Relative Preservation of Advanced Activities in Daily Living among Patients with Mild-to-Moderate Dementia in the Community and Overview of Support Provided by Family Caregivers , 2012, International journal of Alzheimer's disease.

[13]  M. Lawton,et al.  Assessment of older people: self-maintaining and instrumental activities of daily living. , 1969, The Gerontologist.

[14]  J R Hodges,et al.  Activities of daily living in frontotemporal dementia and Alzheimer disease , 2007, Neurology.

[15]  David Challis,et al.  Activities of daily living and quality of life across different stages of dementia: a UK study , 2015, Aging & mental health.

[16]  Shaharyar Kamal,et al.  Real-time life logging via a depth silhouette-based human activity recognition system for smart home services , 2014, 2014 11th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[17]  Michel Vacher,et al.  SVM-Based Multimodal Classification of Activities of Daily Living in Health Smart Homes: Sensors, Algorithms, and First Experimental Results , 2010, IEEE Transactions on Information Technology in Biomedicine.

[18]  S. F.R.,et al.  An Essay towards solving a Problem in the Doctrine of Chances . By the late Rev . Mr . Bayes , communicated by Mr . Price , in a letter to , 1999 .

[19]  Gwenn Englebienne,et al.  An activity monitoring system for elderly care using generative and discriminative models , 2010, Personal and Ubiquitous Computing.

[20]  L. Gibbons,et al.  Quality of life in Alzheimer's disease: Patient and caregiver reports. , 1999 .

[21]  Hong Zhang,et al.  Exploring Techniques for Vision Based Human Activity Recognition: Methods, Systems, and Evaluation , 2013, Sensors.

[22]  G. Englebienne,et al.  Transferring Knowledge of Activity Recognition across Sensor Networks , 2010, Pervasive.

[23]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[24]  JapkowiczNathalie,et al.  The class imbalance problem: A systematic study , 2002 .

[25]  Mark W. Newman,et al.  Automatic Assessment of Cognitive Impairment through Electronic Observation of Object Usage , 2010, Pervasive.

[26]  Magda Tsolaki,et al.  Do Instrumental Activities of Daily Living Predict Dementia at 1‐ and 2‐Year Follow‐Up? Findings from the Development of Screening Guidelines and Diagnostic Criteria for Predementia Alzheimer's Disease Study , 2011, Journal of the American Geriatrics Society.

[27]  João Maroco,et al.  Data mining methods in the prediction of Dementia: A real-data comparison of the accuracy, sensitivity and specificity of linear discriminant analysis, logistic regression, neural networks, support vector machines, classification trees and random forests , 2011, BMC Research Notes.

[28]  Gwenn Englebienne,et al.  UvA-DARE ( Digital Academic Repository ) Activity recognition using semi-Markov models on real world smart home datasets , 2010 .

[29]  T. Rapp,et al.  Differences in resource use and costs of dementia care between European countries: Baseline data from the ictus study , 2010, The journal of nutrition, health & aging.

[30]  Chao Chen,et al.  Using Random Forest to Learn Imbalanced Data , 2004 .

[31]  Chris D. Nugent,et al.  Using duration to learn activities of daily living in a smart home environment , 2010, 2010 4th International Conference on Pervasive Computing Technologies for Healthcare.

[32]  Bernadette Dorizzi,et al.  A pervasive multi-sensor data fusion for smart home healthcare monitoring , 2011, 2011 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2011).

[33]  Tae-Seong Kim,et al.  Human Activity Recognition via Recognized Body Parts of Human Depth Silhouettes for Residents Monitoring Services at Smart Home , 2013 .

[34]  S. Katz,et al.  STUDIES OF ILLNESS IN THE AGED. THE INDEX OF ADL: A STANDARDIZED MEASURE OF BIOLOGICAL AND PSYCHOSOCIAL FUNCTION. , 1963, JAMA.

[35]  Michel Vacher,et al.  Introducing knowledge in the process of supervised classification of activities of Daily Living in Health Smart Homes , 2010, The 12th IEEE International Conference on e-Health Networking, Applications and Services.

[36]  Mahmood Fathy,et al.  Multi-View Human Activity Recognition in Distributed Camera Sensor Networks , 2013, Sensors.

[37]  Carmen D Dirksen,et al.  Literature review on monitoring technologies and their outcomes in independently living elderly people , 2015, Disability and rehabilitation. Assistive technology.

[38]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[39]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[40]  René M. Müri,et al.  Non-intrusive recognition of activities of daily living in the homes of Alzheimer patients , 2013 .

[41]  Huiru Zheng,et al.  Human Activity Detection in Smart Home Environment with Self-Adaptive Neural Networks , 2008, 2008 IEEE International Conference on Networking, Sensing and Control.

[42]  Nathalie Japkowicz,et al.  The class imbalance problem: A systematic study , 2002, Intell. Data Anal..