Activity Recognition in Multi-User Environments Using Techniques of Multi-label Classification

Activity recognition represents the cornerstone in realizing intelligent services such as energy conservation and ambient assisted living in smart environments. The problem statement of most activity recognition research assumes that only mutually exclusive activities occur in smart environments. The majority of research projects in this field focus on single-user environments where only one user performs a single activity at a given time. Such solutions are not applicable in real-world scenarios where multiple users reside in a home performing co-temporal activities. Our work addresses the problem of activity recognition in multi-user environments by utilizing the techniques of multi-label classification. It is based on a multi-label activity recognition dataset which we collected by deploying appliance-level power sensors as well as environmental sensors in a two-person apartment. In this dataset, a feature vector of sensor readings can have more than one label indicating the occurrence of more than one activity at a given time. In this work, we show that recognizing activities in smart environments can be achieved solely based on fine-granular power consumption data and without the need for installing any other sensing modality. Moreover, we prove that extracting and utilizing dependency relations between concurrent activities as well as temporal relations between subsequent activities provide a crucial enhancement of the predictive accuracy of activity recognition models.

[1]  Rong Chen,et al.  A Two-stage Method for Solving Multi-resident Activity Recognition in Smart Environments , 2014, Entropy.

[2]  Rakesh Agarwal,et al.  Fast Algorithms for Mining Association Rules , 1994, VLDB 1994.

[3]  Ig-Jae Kim,et al.  Activity Recognition Using Wearable Sensors for Elder Care , 2008, 2008 Second International Conference on Future Generation Communication and Networking.

[4]  J. Hsu,et al.  Joint Recognition of Multiple Concurrent Activities using Factorial Conditional Random Fields , 2007 .

[5]  Pei Xu,et al.  Extracting Human Behavior Patterns from Appliance-level Power Consumption Data , 2015, EWSN.

[6]  Gwenn Englebienne,et al.  An activity monitoring system for elderly care using generative and discriminative models , 2010, Personal and Ubiquitous Computing.

[7]  Eyke Hüllermeier,et al.  On label dependence and loss minimization in multi-label classification , 2012, Machine Learning.

[8]  Julian Togelius,et al.  Activity recognition in collaborative environments , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[9]  Grigorios Tsoumakas,et al.  Mining Multi-label Data , 2010, Data Mining and Knowledge Discovery Handbook.

[10]  Ramakrishnan Srikant,et al.  Fast Algorithms for Mining Association Rules in Large Databases , 1994, VLDB.

[11]  Kent Larson,et al.  Activity Recognition in the Home Using Simple and Ubiquitous Sensors , 2004, Pervasive.

[12]  K. Hornik,et al.  Unbiased Recursive Partitioning: A Conditional Inference Framework , 2006 .

[13]  Diane J. Cook,et al.  Learning Activity Models for Multiple Agents in a Smart Space , 2010, Handbook of Ambient Intelligence and Smart Environments.

[14]  Tuan Anh Nguyen,et al.  Energy intelligent buildings based on user activity: A survey , 2013 .

[15]  Frank Englert,et al.  SMARTENERGY.KOM: An intelligent system for energy saving in smart home , 2014, 39th Annual IEEE Conference on Local Computer Networks Workshops.