Nonparametric Activity Recognition System in Smart Homes Based on Heterogeneous Sensor Data

Throughout the course of life, there is time when we live independently in our house without anyone to look after each other. In order to support these people and ensure their safety with limited medical resources and human labors, it is important to constantly monitor one’s activity of daily living (ADL). Therefore, we propose an activity recognition (AR) system for people living independently in smart homes to achieve the concept of “aging in place.” The AR model adopted by the proposed system is powerful to recognize meaningful ADL by integrating heterogeneous data from both ambient and on-body sensors. Moreover, this proposed system adopts a nonparametric approach, which requires much fewer efforts from humans. The average AR precision and recall rates of this proposed system are up to 98.7% and 99.0%, which indicates its feasibility of deployment in a real-life home environment for monitoring users’ ADL with promising performance and thus helps realize “aging in place.” Note to Practitioners—With the advance of Internet of Things technologies, it is convenient to collect data about ADL in a smart home environment via ambient sensors and on-body sensors. This proposed system integrates data from these two heterogeneous sensors and discovers potential activities automatically without user labeling or parameter setting. By reducing the above-mentioned user efforts, it is more suitable for users and thus greatly helps realize the concept of “aging in place.”

[1]  Martin L. Griss,et al.  Towards zero-shot learning for human activity recognition using semantic attribute sequence model , 2013, UbiComp.

[2]  Todd Andrew Stephenson,et al.  An Introduction to Bayesian Network Theory and Usage , 2000 .

[3]  Jesús Favela,et al.  Hidden Markov Models for Activity Recognition in Ambient Intelligence Environments , 2007, Eighth Mexican International Conference on Current Trends in Computer Science (ENC 2007).

[4]  Amy Loutfi,et al.  Data Mining for Wearable Sensors in Health Monitoring Systems: A Review of Recent Trends and Challenges , 2013, Sensors.

[5]  Diane J. Cook,et al.  Activity Discovery and Activity Recognition: A New Partnership , 2013, IEEE Transactions on Cybernetics.

[6]  Daniel P. Siewiorek,et al.  Activity recognition and monitoring using multiple sensors on different body positions , 2006, International Workshop on Wearable and Implantable Body Sensor Networks (BSN'06).

[7]  Li-Chen Fu,et al.  Energy-Responsive Aggregate Context for Energy Saving in a Multi-Resident Environment , 2014, IEEE Transactions on Automation Science and Engineering.

[8]  Qing Zhang,et al.  Determination of Activities of Daily Living of independent living older people using environmentally placed sensors , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[9]  Tomoki Toda,et al.  An investigation of recurrent neural network for daily activity recognition using multi-modal signals , 2017, 2017 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC).

[10]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[11]  Martin L. Griss,et al.  Nonparametric discovery of human routines from sensor data , 2014, 2014 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[12]  Marco Morana,et al.  Motion sensors for activity recognition in an ambient-intelligence scenario , 2013, 2013 IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops).

[13]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[14]  B. Kröse,et al.  Bayesian Activity Recognition in Residence for Elders , 2007 .

[15]  Uwe Hansmann,et al.  Pervasive Computing: The Mobile World , 2003 .

[16]  Chia-Tai Chan,et al.  A Reliable Fall Detection System Based on Wearable Sensor and Signal Magnitude Area for Elderly Residents , 2010, ICOST.

[17]  Kent Larson,et al.  Activity Recognition in the Home Using Simple and Ubiquitous Sensors , 2004, Pervasive.

[18]  Sethuraman Panchanathan,et al.  Analysis of low resolution accelerometer data for continuous human activity recognition , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[19]  Norbert Gyorbíró,et al.  An Activity Recognition System For Mobile Phones , 2009, Mob. Networks Appl..

[20]  D. Wade,et al.  The Barthel ADL Index: a reliability study. , 1988, International disability studies.

[21]  John Seely Brown,et al.  The Origins of Ubiquitous Computing Research at PARC in the Late 1980s , 1999, IBM Syst. J..

[22]  James M. Keller,et al.  A fuzzy K-nearest neighbor algorithm , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[23]  Kibong Song,et al.  Human activity recognition using wearable accelerometer sensors , 2016, 2016 IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia).

[24]  Nikolaos G. Bourbakis,et al.  A Survey on Wearable Sensor-Based Systems for Health Monitoring and Prognosis , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[25]  Z. Jane Wang,et al.  Robust recognition of human activities using smartphone sensor data , 2017, 2017 International Conference on the Frontiers and Advances in Data Science (FADS).

[26]  Michael I. Jordan,et al.  Nonparametric empirical Bayes for the Dirichlet process mixture model , 2006, Stat. Comput..

[27]  Davide Anguita,et al.  Human Activity Recognition on Smartphones Using a Multiclass Hardware-Friendly Support Vector Machine , 2012, IWAAL.

[28]  S. E. Hills,et al.  Illustration of Bayesian Inference in Normal Data Models Using Gibbs Sampling , 1990 .

[29]  Li-Chen Fu,et al.  Robust Location-Aware Activity Recognition Using Wireless Sensor Network in an Attentive Home , 2009, IEEE Transactions on Automation Science and Engineering.

[30]  Thomas L. Griffiths,et al.  The nested chinese restaurant process and bayesian nonparametric inference of topic hierarchies , 2007, JACM.