Preference model assisted activity recognition learning in a smart home environment

Reliable recognition of activities from cluttered sensory data is challenging and important for a smart home to enable various activity-aware applications. In addition, understanding a user's preferences and then providing corresponding services is substantial in a smart home environment. Traditionally, activity recognition and preference learning were dealt with separately. In this work, we aim to develop a hybrid system which is the first trial to model the relationship between an activity model and a preference model so that the resultant hybrid model enables a preference model to assist in recovering performance of activity recognition in a dynamic environment. More specifically, on-going activity which a user performs in this work is regarded as high level contexts to assist in building a user's preference model. Based on the learned preference model, the smart home system provides more appropriate services to a user so that the hybrid system can better interact with the user and, more importantly, gain his/her feedback. The feedback is used to detect if there is any change in human behavior or sensor deployment such that the system can adjust the preference model and the activity model in response to the change. Finally, the experimental results confirm the effectiveness of the proposed approach.

[1]  Ramakant Nevatia,et al.  Multi-agent event recognition , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[2]  Svetha Venkatesh,et al.  Recognising Behaviours of Multiple People with Hierarchical Probabilistic Model and Statistical Data Association , 2006, BMVC.

[3]  Christopher G. Atkeson,et al.  Simultaneous Tracking and Activity Recognition (STAR) Using Many Anonymous, Binary Sensors , 2005, Pervasive.

[4]  Eric Horvitz,et al.  Layered representations for human activity recognition , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[5]  Samy Bengio,et al.  Automatic analysis of multimodal group actions in meetings , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Kent Larson,et al.  Activity Recognition in the Home Using Simple and Ubiquitous Sensors , 2004, Pervasive.

[7]  Diane J. Cook,et al.  Adapting to Resident Preferences in Smart Environments , 2008 .

[8]  Gwenn Englebienne,et al.  Accurate activity recognition in a home setting , 2008, UbiComp.

[9]  Alex Pentland,et al.  A Bayesian Computer Vision System for Modeling Human Interactions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Henry A. Kautz,et al.  Improving the recognition of interleaved activities , 2008, UbiComp.

[11]  Qiang Yang,et al.  Real world activity recognition with multiple goals , 2008, UbiComp.