Activity Recognition in Smart Homes

In recent years, activity recognition in smart homes is an active research area. It is an important problem of Human Computer Interaction (HCI), and has many applications in HCI, such as assistive living and healthcare. Recognition of users’ common behaviors allows an environment to provide personalized service. Unlike activity recognition in computer vision which uses cameras, it studies activities by embedded sensors in smart homes. In this paper, we propose a method to extract latent features from sensor data by Beta Process Hidden Markov Model (BP-HMM). The contributions of our method are twofold: 1, we extend BP-HMM by dependent Beta process, and integrate state constraints of sensors into the sampling process of BP-HMM. 2, we extract latent features automatically by our dependent BP-HMM, and train a structural support vector machine (SVM) by these features in a supervised way for activity recognition. To evaluate the proposed method, we performed experiments on the real-world smart home datasets. Our results suggest that extracting latent features from sensor data leads to good performance for activity recognition.

[1]  David B. Dunson,et al.  Dependent Hierarchical Beta Process for Image Interpolation and Denoising , 2011, AISTATS.

[2]  Eric P. Xing,et al.  MedLDA: maximum margin supervised topic models for regression and classification , 2009, ICML '09.

[3]  Michael I. Jordan,et al.  Sharing Features among Dynamical Systems with Beta Processes , 2009, NIPS.

[4]  Gregory D. Abowd,et al.  The Aware Home: A Living Laboratory for Ubiquitous Computing Research , 1999, CoBuild.

[5]  Mark Steyvers,et al.  Finding scientific topics , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Friedrich Foerster,et al.  Detection of posture and motion by accelerometry : a validation study in ambulatory monitoring , 1999 .

[7]  Lawrence B. Holder,et al.  Discovering Activities to Recognize and Track in a Smart Environment , 2011, IEEE Transactions on Knowledge and Data Engineering.

[8]  Young-Koo Lee,et al.  Analysis and effects of smart home dataset characteristics for daily life activity recognition , 2013, The Journal of Supercomputing.

[9]  Chong Wang,et al.  Simultaneous image classification and annotation , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Niall Twomey,et al.  Bayesian Modelling of the Temporal Aspects of Smart Home Activity with Circular Statistics , 2015, ECML/PKDD.

[11]  Zhiying Wang,et al.  Activity recognition with weighted frequent patterns mining in smart environments , 2015, Expert Syst. Appl..

[12]  Zoubin Ghahramani,et al.  Correlated Non-Parametric Latent Feature Models , 2009, UAI.

[13]  Zoubin Ghahramani,et al.  Dependent Indian Buffet Processes , 2010, AISTATS.

[14]  Stan Sclaroff,et al.  A Unified Framework for Gesture Recognition and Spatiotemporal Gesture Segmentation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Diane J. Cook,et al.  Activity recognition on streaming sensor data , 2014, Pervasive Mob. Comput..

[16]  Ben Kröse,et al.  Care: context awareness in residences for elderly , 2008 .

[17]  Diane J. Cook,et al.  Recognizing independent and joint activities among multiple residents in smart environments , 2010, J. Ambient Intell. Humaniz. Comput..

[18]  Kent Larson,et al.  Using a Live-In Laboratory for Ubiquitous Computing Research , 2006, Pervasive.

[19]  Muttukrishnan Rajarajan,et al.  Activity Recognition in Smart Homes Using Clustering Based Classification , 2014, 2014 22nd International Conference on Pattern Recognition.

[20]  Hoon Kim,et al.  Monte Carlo Statistical Methods , 2000, Technometrics.

[21]  Muttukrishnan Rajarajan,et al.  Long term analysis of daily activities in smart home , 2013, ESANN.

[22]  Maria E. Niessen,et al.  A Unified Model for Human Behavior Modeling Using a Hierarchy with a Variable Number of States , 2014, 2014 22nd International Conference on Pattern Recognition.

[23]  Greg Mori,et al.  IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL., NO. 1 Human Action Recognition by Semi-Latent Topic Models , 2022 .

[24]  Aitor Almeida,et al.  Extending knowledge-driven activity models through data-driven learning techniques , 2015, Expert Syst. Appl..

[25]  Michel Vacher,et al.  SVM-Based Multimodal Classification of Activities of Daily Living in Health Smart Homes: Sensors, Algorithms, and First Experimental Results , 2010, IEEE Transactions on Information Technology in Biomedicine.

[26]  Yang Wang,et al.  Human Action Recognition by Semilatent Topic Models , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Jiahui Wen,et al.  Activity discovering and modelling with labelled and unlabelled data in smart environments , 2015, Expert Syst. Appl..

[28]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[29]  Sethuraman Panchanathan,et al.  Analysis of low resolution accelerometer data for continuous human activity recognition , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[30]  Ahmad Lotfi,et al.  Behavioural pattern identification and prediction in intelligent environments , 2013, Appl. Soft Comput..

[31]  Gwenn Englebienne,et al.  Hierarchical Activity Recognition Using Automatically Clustered Actions , 2011, AmI.

[32]  Ramesh Nallapati,et al.  Labeled LDA: A supervised topic model for credit attribution in multi-labeled corpora , 2009, EMNLP.

[33]  Thomas Hofmann,et al.  Support vector machine learning for interdependent and structured output spaces , 2004, ICML.

[34]  Thomas L. Griffiths,et al.  The Phylogenetic Indian Buffet Process: A Non-Exchangeable Nonparametric Prior for Latent Features , 2008, UAI.

[35]  Blake Hannaford,et al.  A Hybrid Discriminative/Generative Approach for Modeling Human Activities , 2005, IJCAI.

[36]  Andrei Tolstikov,et al.  Comparison of fusion methods based on DST and DBN in human activity recognition , 2011 .