Semantic classification of human behaviors in video surveillance systems

The semantic analysis of the human behavior in video streaming is still an open issue for the computer vision research community, especially when real-time analysis of complex scenes is concerned. The researchers' community has achieved many progresses in this field. A popular class of approaches has been devised to enhance the quality of the semantic analysis by exploiting some background knowledge about scene and/or the human behavior, thus narrowing the huge variety of possible behavioral patterns by focusing on a specific narrow domain. Aim of this paper is to present an innovative method for semantic analysis of human behavior in video surveillance systems. Typically, this kind of systems are composed of a set of fixed cameras each one monitoring a fixed area. In the proposed methodology, the actions performed by the human beings are described by means of symbol strings. For each camera a grammar is defined to classify the strings of symbols describing the various behaviors. This system proposes a generative approach to human behavior description so it does not require a learning stage. Another advantage of this approach consists in the simplicity of the scene and motion descriptions so that the behavior analysis will have limited computational complexity due to the intrinsic nature both of the representations and the related operations used to manipulate them. This methodology has been used to implement a system to classify human behaviors in a scene. The results are discussed in this paper and they seem to be encouraging.

[1]  Barbara Majecka,et al.  Statistical models of pedestrian behaviour in the Forum , 2009 .

[2]  Mubarak Shah,et al.  Actions sketch: a novel action representation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[3]  Pietro Perona,et al.  Decomposition of human motion into dynamics-based primitives with application to drawing tasks , 2003, Autom..

[4]  James W. Davis,et al.  The Recognition of Human Movement Using Temporal Templates , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[6]  Honghai Liu,et al.  Advances in View-Invariant Human Motion Analysis: A Review , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[7]  Aaron F. Bobick,et al.  Recognition of Visual Activities and Interactions by Stochastic Parsing , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Jake K. Aggarwal,et al.  Semantic-level Understanding of Human Actions and Interactions using Event Hierarchy , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[9]  Rama Chellappa,et al.  View Invariance for Human Action Recognition , 2005, International Journal of Computer Vision.

[10]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[11]  Ian D. Reid,et al.  Behaviour understanding in video: a combined method , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[12]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Luc Van Gool,et al.  DOG-based unsupervised clustering for CBIR , 1997 .

[14]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[15]  Isaac Weiss,et al.  Model-Based Recognition of 3D Objects from Single Images , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Mubarak Shah,et al.  Multi feature path modeling for video surveillance , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[17]  Mubarak Shah,et al.  View-Invariant Representation and Recognition of Actions , 2002, International Journal of Computer Vision.

[18]  Michal Irani,et al.  Detecting Irregularities in Images and in Video , 2005, ICCV.