Learning and matching human activities using regular expressions

In this paper we propose a novel method to analyze trajectories in surveillance scenarios relying on automatically learned Context-Free Grammars. Given a training corpus of trajectories associated to a set of actions, an initial processing is carried out to extract the syntactical structure of the activities; then, the rules characterizing different behaviors are retrieved and coded as CFG models. The classification of the new trajectories vs the learned templates is performed through a parsing engine allowing the online recognition as well as the detection of nested activities. The proposed system has been validated in the framework of assisted living applications. The obtained results demonstrate the capability of the system in recognizing activity patterns in different configurations, also in presence of noise.

[1]  Aaron F. Bobick,et al.  Recognition of Visual Activities and Interactions by Stochastic Parsing , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Francesco G. B. De Natale,et al.  Object Trajectory Analysis in Video Indexing and Retrieval Applications , 2010, Video Search and Mining.

[3]  Pieter W. Adriaans,et al.  The EMILE 4.1 Grammar Induction Toolbox , 2002, ICGI.

[4]  Irfan A. Essa,et al.  Expectation grammars: leveraging high-level expectations for activity recognition , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[5]  Svetha Venkatesh,et al.  Activity recognition and abnormality detection with the switching hidden semi-Markov model , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[6]  Francesco G. B. De Natale,et al.  Activity detection using regular expressions , 2010, 11th International Workshop on Image Analysis for Multimedia Interactive Services WIAMIS 10.

[7]  Irfan A. Essa,et al.  A novel sequence representation for unsupervised analysis of human activities , 2009, Artif. Intell..

[8]  Jay Earley,et al.  An efficient context-free parsing algorithm , 1970, Commun. ACM.