Bayesian Generative Model Based on Color Histogram of Oriented Phase and Histogram of Oriented Optical Flow for Rare Event Detection in Crowded Scenes

In this paper, we propose a new method for rare event detection in crowded scenes using a combination of Color Histogram of Oriented Phases (CHOP) and Histogram of Oriented Optical Flow (HOOF). We propose to detect and filter spatio-temporal interest points (STIP) based on the visual saliency information of the scene. Once salient STIPs are detected, the motion and appearance information of the surrounding scene are extracted. Finally, the extracted information from normal scenes are modelled by using a Bayesian generative model (Latent Dirichlet Allocation). The rare events are detected by processing the likelihood of the current scene in regard to the obtained model. The proposed method has been tested on the publicly available UMN dataset and compared with different state-of-the-art algorithms. We have shown that our method is very competitive and provides promising results.

[1]  How-Lung Eng,et al.  A Literature Review on Video Analytics of Crowded Scenes , 2013, Intelligent Multimedia Surveillance.

[2]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[3]  Christof Koch,et al.  Image Signature: Highlighting Sparse Salient Regions , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Junsong Yuan,et al.  Sparse reconstruction cost for abnormal event detection , 2011, CVPR 2011.

[5]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[6]  C. Krishna Mohan,et al.  Graph formulation of video activities for abnormal activity recognition , 2017, Pattern Recognit..

[7]  Zhenjiang Miao,et al.  Abnormal event detection based on sparse reconstruction in crowded scenes , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[8]  Peter Kovesi,et al.  Phase Congruency Detects Corners and Edges , 2003, DICTA.

[9]  Xiaoqiang Lu,et al.  Learning deep event models for crowd anomaly detection , 2017, Neurocomputing.

[10]  Robyn A. Owens,et al.  Feature detection from local energy , 1987, Pattern Recognit. Lett..

[11]  Ramin Mehran,et al.  Abnormal crowd behavior detection using social force model , 2009, CVPR.

[12]  R. Vidal,et al.  Histograms of oriented optical flow and Binet-Cauchy kernels on nonlinear dynamical systems for the recognition of human actions , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Vijayan K. Asari,et al.  Color and local phase based descriptor for human detection , 2016, 2016 IEEE National Aerospace and Electronics Conference (NAECON) and Ohio Innovation Summit (OIS).

[14]  Yinghuan Shi,et al.  Real-Time Abnormal Event Detection in Complicated Scenes , 2010, 2010 20th International Conference on Pattern Recognition.