Behavior Modeling and Recognition Based on Space-Time Image Features

A novel method based on space-time image features is proposed for automatic behavior modeling and recognition. The method is composed of the following three steps: (1) video sequences are converted into a space-time image, and the image is divided into equal length segments; (2) from these segments, an unsupervised technique based on Dynamic Time Warping is used to determine the groups of different behaviors; (3) the behavior templates are built according to these groups, and are used for the recognition of behaviors. The method does not need to track the body parts and can model the behaviors without any prior knowledge. Experiments also demonstrate the effectiveness of our new method

[1]  Shaogang Gong,et al.  Video behaviour profiling and abnormality detection without manual labelling , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[2]  Shaogang Gong,et al.  Recognition of group activities using dynamic probabilistic networks , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[3]  Yee-Hong Yang,et al.  The background primal sketch: An approach for tracking moving objects , 1992, Machine Vision and Applications.

[4]  Hong Li,et al.  Multi-scale gesture recognition from time-varying contours , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[5]  A. Corradini,et al.  Dynamic time warping for off-line recognition of a small gesture vocabulary , 2001, Proceedings IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems.

[6]  Yair Weiss,et al.  Segmentation using eigenvectors: a unifying view , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[7]  Eamonn J. Keogh,et al.  Iterative Deepening Dynamic Time Warping for Time Series , 2002, SDM.

[8]  Ivan Laptev,et al.  On Space-Time Interest Points , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[9]  James W. Davis,et al.  The Recognition of Human Movement Using Temporal Templates , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Lihi Zelnik-Manor,et al.  Event-based analysis of video , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.