Multi-Resident Activity Monitoring in Smart Homes: A Case Study

This paper demonstrates a system that can turn a normal house to a smart house for daily activity monitoring with the use of ambient sensors. We show a proof of concept which includes a method of annotation using voice recording and deep learning technique for automatic recognition. Our multi-resident activity recognition system (MRAR) is designed to support multiple occupants in a house with minimum impact on their living styles. We evaluate the system in a real house lived by a family of three. The experimental results show that it is promising to develop a smart home system for multiple residents which is portable and easy to deploy.

[1]  Luming Zhang,et al.  Action2Activity: Recognizing Complex Activities from Sensor Data , 2015, IJCAI.

[2]  Chris D. Nugent,et al.  A Knowledge-Driven Approach to Activity Recognition in Smart Homes , 2012, IEEE Transactions on Knowledge and Data Engineering.

[3]  Li Liu,et al.  Recognizing Complex Activities by a Probabilistic Interval-Based Model , 2016, AAAI.

[4]  S Szewcyzk,et al.  Annotating smart environment sensor data for activity learning. , 2009, Technology and health care : official journal of the European Society for Engineering and Medicine.

[5]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[6]  Diane J. Cook,et al.  Recognizing independent and joint activities among multiple residents in smart environments , 2010, J. Ambient Intell. Humaniz. Comput..

[7]  Patrick Olivier,et al.  Feature Learning for Activity Recognition in Ubiquitous Computing , 2011, IJCAI.

[8]  Diane J. Cook,et al.  Learning Setting-Generalized Activity Models for Smart Spaces , 2012, IEEE Intelligent Systems.

[9]  Jian Lu,et al.  Recognizing multi-user activities using wearable sensors in a smart home , 2011, Pervasive Mob. Comput..

[10]  Mohammed Feham,et al.  Multioccupant Activity Recognition in Pervasive Smart Home Environments , 2015, ACM Comput. Surv..

[11]  Abdelhamid Bouchachia,et al.  Multi-resident Activity Recognition Using Incremental Decision Trees , 2014, ICAIS.

[12]  Diane J. Cook,et al.  Real-Time Annotation Tool (RAT) , 2013, AAAI 2013.

[13]  Rong Chen,et al.  A Two-stage Method for Solving Multi-resident Activity Recognition in Smart Environments , 2014, Entropy.

[14]  Andrew McCallum,et al.  Dynamic conditional random fields: factorized probabilistic models for labeling and segmenting sequence data , 2004, J. Mach. Learn. Res..

[15]  Chris D. Nugent,et al.  An Ontology-Based Hybrid Approach to Activity Modeling for Smart Homes , 2014, IEEE Transactions on Human-Machine Systems.

[16]  Ronald Poppe,et al.  A survey on vision-based human action recognition , 2010, Image Vis. Comput..

[17]  Diane J. Cook,et al.  DETECTION OF SOCIAL INTERACTION IN SMART SPACES , 2010, Cybern. Syst..

[18]  Özlem Durmaz Incel,et al.  ARAS human activity datasets in multiple homes with multiple residents , 2013, 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops.

[19]  Yi-Ting Chiang,et al.  Strategies for Inference Mechanism of Conditional Random Fields for Multiple-Resident Activity Recognition in a Smart Home , 2010, IEA/AIE.

[20]  Yi-Ting Chiang,et al.  Interaction models for multiple-resident activity recognition in a smart home , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.