Towards Multi-resident Activity Monitoring with Smarter Safer Home Platform

This chapter demonstrates a system that can turn a normal house to a smart house for daily activity monitoring with the use of ambient sensors. We first introduce our smarter safer home platform and its applications in supporting independent livings of seniors in their own home. Then we show a proof of concept which includes a novel activity annotation method through voice recording and deep learning techniques for automatic activity recognition. Our multi-resident activity recognition system (MRAR) is designed to support multiple occupants in a house with minimum impact on their living styles. We evaluate the system in a real house lived by a family of three. The experimental results show that it is promising to develop a smart home system for multiple residents which is portable and easy to deploy.

[1]  Claudio Bettini,et al.  Is ontology-based activity recognition really effective? , 2011, 2011 IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops).

[2]  Bo Yang,et al.  Smart home research , 2004, Proceedings of 2004 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.04EX826).

[3]  Mohan Karunanithi,et al.  Improving Multi-resident Activity Recognition for Smarter Homes , 2017 .

[4]  Youtian Du,et al.  Recognizing Interaction Activities using Dynamic Bayesian Network , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[5]  Tae-Seong Kim,et al.  Depth video-based human activity recognition system using translation and scaling invariant features for life logging at smart home , 2012, IEEE Transactions on Consumer Electronics.

[6]  Chris D. Nugent,et al.  An Ontology-Based Hybrid Approach to Activity Modeling for Smart Homes , 2014, IEEE Transactions on Human-Machine Systems.

[7]  Yi-Ting Chiang,et al.  Interaction models for multiple-resident activity recognition in a smart home , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[9]  Luming Zhang,et al.  Action2Activity: Recognizing Complex Activities from Sensor Data , 2015, IJCAI.

[10]  Jian Lu,et al.  Recognizing multi-user activities using wearable sensors in a smart home , 2011, Pervasive Mob. Comput..

[11]  Li Liu,et al.  Recognizing Complex Activities by a Probabilistic Interval-Based Model , 2016, AAAI.

[12]  Gwenn Englebienne,et al.  Accurate activity recognition in a home setting , 2008, UbiComp.

[13]  Chris D. Nugent,et al.  A Knowledge-Driven Approach to Activity Recognition in Smart Homes , 2012, IEEE Transactions on Knowledge and Data Engineering.

[14]  Abdelhamid Bouchachia,et al.  Multi-resident Activity Recognition Using Incremental Decision Trees , 2014, ICAIS.

[15]  Diane J. Cook,et al.  Real-Time Annotation Tool (RAT) , 2013, AAAI 2013.

[16]  Rita Cucchiara,et al.  Computer vision system for in-house video surveillance , 2005 .

[17]  Henry A. Kautz,et al.  Location-Based Activity Recognition using Relational Markov Networks , 2005, IJCAI.

[18]  R. Lutolf,et al.  Smart Home concept and the integration of energy meters into a home based system , 1992 .

[19]  Dana Bradford,et al.  Sensors on My Bed: The Ups and Downs of In-Home Monitoring , 2013, ICOST.

[20]  Svetha Venkatesh,et al.  Recognising Behaviours of Multiple People with Hierarchical Probabilistic Model and Statistical Data Association , 2006, BMVC.

[21]  Gwenn Englebienne,et al.  Hierarchical Activity Recognition Using Automatically Clustered Actions , 2011, AmI.

[22]  Rong Chen,et al.  A Two-stage Method for Solving Multi-resident Activity Recognition in Smart Environments , 2014, Entropy.

[23]  Diane J. Cook,et al.  Behavior-Based Home Energy Prediction , 2012, 2012 Eighth International Conference on Intelligent Environments.

[24]  Peter H. N. de With,et al.  Employing a RGB-D sensor for real-time tracking of humans across multiple re-entries in a smart environment , 2012, IEEE Transactions on Consumer Electronics.

[25]  Diane J. Cook,et al.  Learning Setting-Generalized Activity Models for Smart Spaces , 2012, IEEE Intelligent Systems.

[26]  Youtian Du,et al.  Human Interaction Representation and Recognition Through Motion Decomposition , 2007, IEEE Signal Processing Letters.

[27]  Diane J. Cook,et al.  How smart are our environments? An updated look at the state of the art , 2007, Pervasive Mob. Comput..

[28]  Mohamed Sedky,et al.  OpenSHS: Open Smart Home Simulator , 2017, Sensors.

[29]  Gwenn Englebienne,et al.  Human activity recognition from wireless sensor network data: benchmark and software , 2011 .

[30]  Shehroz S. Khan,et al.  Towards the detection of unusual temporal events during activities using HMMs , 2012, UbiComp '12.

[31]  Diane J. Cook,et al.  Recognizing independent and joint activities among multiple residents in smart environments , 2010, J. Ambient Intell. Humaniz. Comput..

[32]  Mohammed Feham,et al.  Multioccupant Activity Recognition in Pervasive Smart Home Environments , 2015, ACM Comput. Surv..

[33]  Diane J. Cook,et al.  Attributing events to individuals in multi-inhabitant environments , 2008 .

[34]  Andrew McCallum,et al.  Dynamic conditional random fields: factorized probabilistic models for labeling and segmenting sequence data , 2004, J. Mach. Learn. Res..

[35]  Özlem Durmaz Incel,et al.  Multimodal Wireless Sensor Network-Based Ambient Assisted Living in Real Homes with Multiple Residents , 2014, Sensors.

[36]  Katsuhiko Sakaue,et al.  Arm-pointing gesture interface using surrounded stereo cameras system , 2004, ICPR 2004.

[37]  Diane J. Cook,et al.  DETECTION OF SOCIAL INTERACTION IN SMART SPACES , 2010, Cybern. Syst..

[38]  Yang Liu,et al.  Collaborative Security , 2015, ACM Comput. Surv..

[39]  Yi-Ting Chiang,et al.  Strategies for Inference Mechanism of Conditional Random Fields for Multiple-Resident Activity Recognition in a Smart Home , 2010, IEA/AIE.

[40]  Qing Zhang,et al.  Multi-Resident Activity Monitoring in Smart Homes: A Case Study , 2018, 2018 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops).

[41]  Samy Bengio,et al.  Automatic analysis of multimodal group actions in meetings , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  S Szewcyzk,et al.  Annotating smart environment sensor data for activity learning. , 2009, Technology and health care : official journal of the European Society for Engineering and Medicine.

[43]  Kent Larson,et al.  Activity Recognition in the Home Using Simple and Ubiquitous Sensors , 2004, Pervasive.

[44]  Patrick Olivier,et al.  Feature Learning for Activity Recognition in Ubiquitous Computing , 2011, IJCAI.

[45]  Henry A. Kautz,et al.  Inferring activities from interactions with objects , 2004, IEEE Pervasive Computing.

[46]  Özlem Durmaz Incel,et al.  ARAS human activity datasets in multiple homes with multiple residents , 2013, 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops.