A class of space-varying parametric motion fields for human activity recognition

Video cameras monitoring human activities in public spaces are commonplace in cities worldwide. Such monitoring task is important for safety and security purposes but is also extremely challenging. In this paper, we propose a class of algorithms for far-field human activity recognition, a central task in video surveillance. More specifically, we explore a class of parametric motion vector fields learned from the trajectories described by people in real-world scenarios. The work proposed herein is a space dependent framework, in sense that the vector fields depend on the pedestrian position. Thus, the model is flexible leading to an expressive description of complex trajectories. Also, a model selection strategy is addressed to automatically choose the appropriate number of underlying motion fields presented in the trajectories. Experimental evaluation is conducted in real settings testifying the usefulness of the proposed approach for human activity recognition.

[1]  W. Eric L. Grimson,et al.  Trajectory analysis and semantic region modeling using a nonparametric Bayesian model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Terrance E. Boult,et al.  Into the woods: visual surveillance of noncooperative and camouflaged targets in complex outdoor settings , 2001, Proc. IEEE.

[3]  Michal Irani,et al.  Detecting Irregularities in Images and in Video , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[4]  Mubarak Shah,et al.  Multi feature path modeling for video surveillance , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[5]  Svetha Venkatesh,et al.  Activity recognition and abnormality detection with the switching hidden semi-Markov model , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[6]  Mário A. T. Figueiredo,et al.  Classification of complex pedestrian activities from trajectories , 2010, 2010 IEEE International Conference on Image Processing.

[7]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[8]  Augusto Sarti,et al.  Clustering of human actions using invariant body shape descriptor and dynamic time warping , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[9]  Tieniu Tan,et al.  Similarity based vehicle trajectory clustering and anomaly detection , 2005, IEEE International Conference on Image Processing 2005.