Modeling interaction in multi-resident activities

In this paper we investigate the problem of modeling multi-resident activities. Specifically, we explore different approaches based on Hidden Markov Models (HMMs) to deal with parallel activities and cooperative activities. We propose an HMM-based method, called CL-HMM, where activity labels as well as observation labels of different residents are combined to generate the corresponding sequence of activities as well as the corresponding sequence of observations on which a conventional HMM is applied. We also propose a Linked HMM (LHMM) in which activities of all residents are linked at each time step. We compare these two models to baseline models which are Coupled HMM (CHMM) and Parallel HMM (PHMM). The experimental results show that the proposed models outperform CHMM and PHMM when tested on parallel and cooperative activities.

[1]  Matthew Brand,et al.  Coupled hidden Markov models for modeling interacting processes , 1997 .

[2]  Iván Pau,et al.  The Elderly’s Independent Living in Smart Homes: A Characterization of Activities and Sensing Infrastructure Survey to Facilitate Services Development , 2015, Sensors.

[3]  Diane J. Cook,et al.  Infrastructure-assisted smartphone-based ADL recognition in multi-inhabitant smart environments , 2013, 2013 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[4]  Jian Lu,et al.  Sensor-Based Human Activity Recognition in a Multi-user Scenario , 2009, AmI.

[5]  Diane J. Cook,et al.  Ambient and smartphone sensor assisted ADL recognition in multi-inhabitant smart environments , 2016, J. Ambient Intell. Humaniz. Comput..

[6]  Yi-Ting Chiang,et al.  Strategies for Inference Mechanism of Conditional Random Fields for Multiple-Resident Activity Recognition in a Smart Home , 2010, IEA/AIE.

[7]  Abdelhamid Bouchachia,et al.  Multi-resident Activity Recognition Using Incremental Decision Trees , 2014, ICAIS.

[8]  Özlem Durmaz Incel,et al.  Multimodal Wireless Sensor Network-Based Ambient Assisted Living in Real Homes with Multiple Residents , 2014, Sensors.

[9]  Luming Zhang,et al.  Action2Activity: Recognizing Complex Activities from Sensor Data , 2015, IJCAI.

[10]  Gwenn Englebienne,et al.  Accurate activity recognition in a home setting , 2008, UbiComp.

[11]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[12]  Rong Chen,et al.  A Two-stage Method for Solving Multi-resident Activity Recognition in Smart Environments , 2014, Entropy.

[13]  Jian Lu,et al.  Mining Emerging Patterns for recognizing activities of multiple users in pervasive computing , 2009, 2009 6th Annual International Mobile and Ubiquitous Systems: Networking & Services, MobiQuitous.

[14]  Jian Lu,et al.  Recognizing multi-user activities using wearable sensors in a smart home , 2011, Pervasive Mob. Comput..

[15]  Abdelhamid Bouchachia,et al.  A review of smart homes in healthcare , 2015, J. Ambient Intell. Humaniz. Comput..

[16]  Diane J. Cook,et al.  DETECTION OF SOCIAL INTERACTION IN SMART SPACES , 2010, Cybern. Syst..

[17]  Diane J. Cook,et al.  Recognizing independent and joint activities among multiple residents in smart environments , 2010, J. Ambient Intell. Humaniz. Comput..

[18]  Kevin P. Murphy,et al.  A coupled HMM for audio-visual speech recognition , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[19]  John A. Stankovic,et al.  SARRIMA: smart ADL recognizer and resident identifier in multi-resident accommodations , 2015, Wireless Health.

[20]  Mohammed Feham,et al.  Multioccupant Activity Recognition in Pervasive Smart Home Environments , 2015, ACM Comput. Surv..

[21]  Enamul Hoque,et al.  AALO: Activity recognition in smart homes using Active Learning in the presence of Overlapped activities , 2012, 2012 6th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[22]  Özlem Durmaz Incel,et al.  ARAS human activity datasets in multiple homes with multiple residents , 2013, 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops.

[23]  Yi-Ting Chiang,et al.  Interaction models for multiple-resident activity recognition in a smart home , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Georgios Meditskos,et al.  ReDef: Context-aware Recognition of Interleaved Activities using OWL 2 and Defeasible Reasoning , 2015, SSN-TC/OrdRing@ISWC.

[25]  Gwenn Englebienne,et al.  Human activity recognition from wireless sensor network data: benchmark and software , 2011 .