Detecting and predicting of abnormal behavior using hierarchical Markov model in smart home network

In this paper, we present an application of the hierarchical hidden Markov model (HHMM) for the problem of predicting the state of human behavior in a smart home network. We argue that to robustly model and recognize sequential human activities, it is crucial to exploit both the natural hierarchical decomposition and shared semantics embedded in a ubiquitous environment. To this end, we propose the use of the HHMM, a rich stochastic model that has recently been extended to handle shared structures, for representing and recognizing a set of complex indoor activities. The main contributions of this paper lie in the application of the shared structure HHMM, the estimation of the state of a user's behavior, and the detection of abnormal behavior. The user behavior data from an experiment show that directly modeling shared structures improves the recognition efficiency and prediction accuracy for the state of a human's behavior when compared with a flat HMM.

[1]  Svetha Venkatesh,et al.  Policy Recognition in the Abstract Hidden Markov Model , 2002, J. Artif. Intell. Res..

[2]  S. Shiffman,et al.  Ecological Momentary Assessment (Ema) in Behavioral Medicine , 1994 .

[3]  Yoram Singer,et al.  The Hierarchical Hidden Markov Model: Analysis and Applications , 1998, Machine Learning.

[4]  Kent Larson,et al.  Tools for Studying Behavior and Technology in Natural Settings , 2003, UbiComp.

[5]  Li-Chen Fu,et al.  A human-system interaction framework and algorithm for UbiComp-based smart home , 2008, 2008 Conference on Human System Interactions.

[6]  Ling Bao,et al.  A context-aware experience sampling tool , 2003, CHI Extended Abstracts.

[7]  Eric Horvitz,et al.  Layered representations for human activity recognition , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[8]  M. Csíkszentmihályi,et al.  Validity and Reliability of the Experience‐Sampling Method , 1987, The Journal of nervous and mental disease.

[9]  Alex Pentland,et al.  A Bayesian Computer Vision System for Modeling Human Interactions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Michael P. Wellman,et al.  Generalized Queries on Probabilistic Context-Free Grammars , 1996, AAAI/IAAI, Vol. 2.

[11]  Svetha Venkatesh,et al.  Learning Hierarchical Hidden Markov Models with General State Hierarchy , 2004, AAAI.

[12]  David C. Hogg,et al.  Learning Variable-Length Markov Models of Behavior , 2001, Comput. Vis. Image Underst..

[13]  Emmanuel,et al.  Activity recognition in the home setting using simple and ubiquitous sensors , 2003 .