Abnormal behavior analysis using LDA

An abnormal behavior analysis method based on bag-of-words model and Latent Dirichlet Allocation was proposed. A video is representedas a collection of spatial-temporal words by using a Gabor filter to extractspace-time interest points. As the noise of the camera and the movement in neighboring frame can also be detected by the filter, we remove the redundant points. Using the 3D-sift features to describe the points and k-means algorithm to cluster the points into words. A video is processing as a text, and the interest points are the words. The LDA assuming that there are some latent topics between the words and the text, and analyzingthe video by the distributing of topic. Although our method uses fewer interest points, it can get a good accuracy. The algorithm was tested on the challenging datasets: Weizmann human action datasets and KTH datasets.

[1]  Daniel P. Huttenlocher,et al.  Pictorial Structures for Object Recognition , 2004, International Journal of Computer Vision.

[2]  Juan Carlos Niebles,et al.  Unsupervised Learning of Human Action Categories Using Spatial-Temporal Words , 2006, BMVC.

[3]  Mubarak Shah,et al.  A 3-dimensional sift descriptor and its application to action recognition , 2007, ACM Multimedia.

[4]  Serge J. Belongie,et al.  Behavior recognition via sparse spatio-temporal features , 2005, 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance.

[5]  Thomas Hofmann,et al.  Probabilistic latent semantic indexing , 1999, SIGIR '99.

[6]  Alexei A. Efros,et al.  Discovering objects and their location in images , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[7]  Yung-Cheol Byun,et al.  Intrusion detection based on clustering a data stream , 2005, Third ACIS Int'l Conference on Software Engineering Research, Management and Applications (SERA'05).

[8]  Mubarak Shah,et al.  Actions sketch: a novel action representation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Hsuan-Sheng Chen,et al.  Human action recognition using star skeleton , 2006, VSSN '06.

[11]  Ronen Basri,et al.  Actions as Space-Time Shapes , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Juan Carlos Niebles,et al.  Unsupervised Learning of Human Action Categories Using Spatial-Temporal Words , 2008, International Journal of Computer Vision.

[13]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..