Density aware anomaly detection in crowded scenes

Coherent nature of crowd movement allows representing the crowd motion using sparse features. However, surveillance videos recorded at different periods of time are likely to have different crowd densities and motion characteristics. These varying scene properties necessitate use of different models for an effective representation of behaviour at different periods. In this study, a density aware approach is proposed to detect motion-based anomalies for scenes having varying crowd densities. In the training, the sparse features are modelled using separate hidden Markov models, each of which becomes an expert for specific scene characteristics. These models are then used for anomaly detection. The proposed method automatically adapts to the changing scene dynamics by switching to the most representative model at each frame. The authors demonstrate the effectiveness and real-time performance of the proposed method on real-life datasets as well as on simulated crowd videos that they generated and made publicly available to download.

[1]  Alptekin Temizel,et al.  Particle filter based Conjoint Individual-Group Tracker (CIGT) , 2015, 2015 12th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[2]  Gunnar Farnebäck,et al.  Two-Frame Motion Estimation Based on Polynomial Expansion , 2003, SCIA.

[3]  Yu Zhu,et al.  Scenario Simulation: Theory and methodology , 1996, Finance Stochastics.

[4]  Nicola Conci,et al.  Real-time anomaly detection in dense crowded scenes , 2014, Electronic Imaging.

[5]  Sergio A. Velastin,et al.  Modelling periodic scene elements for visual surveillance , 2008 .

[6]  Alberto Del Bimbo,et al.  Dense spatio-temporal features for non-parametric anomaly detection and localization , 2010, ARTEMIS '10.

[7]  Ramin Mehran,et al.  Abnormal crowd behavior detection using social force model , 2009, CVPR.

[8]  Nicola Conci,et al.  Dominant Motion Analysis in Regular and Irregular Crowd Scenes , 2014, HBU.

[9]  Jean-Luc Dugelay,et al.  Towards crowd density-aware video surveillance applications , 2015, Inf. Fusion.

[10]  Alessio Del Bue,et al.  Abnormal Crowd Behavior Detection by Social Force Optimization , 2011, HBU.

[11]  Ehud Rivlin,et al.  Robust Real-Time Unusual Event Detection using Multiple Fixed-Location Monitors , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[13]  Sridha Sridharan,et al.  Textures of optical flow for real-time anomaly detection in crowds , 2011, 2011 8th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[14]  Mubarak Shah,et al.  Identifying Behaviors in Crowd Scenes Using Stability Analysis for Dynamical Systems , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Christopher M. Bishop,et al.  Mixtures of Probabilistic Principal Component Analyzers , 1999, Neural Computation.

[16]  Alptekin Temizel,et al.  An unsupervised method for anomaly detection from crowd videos , 2013, 2013 21st Signal Processing and Communications Applications Conference (SIU).

[17]  Kevin Murphy,et al.  Bayes net toolbox for Matlab , 1999 .

[18]  Alptekin Temizel,et al.  Pedestrian zone anomaly detection by non-parametric temporal modelling , 2014, 2014 11th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[19]  Hyeran Byun,et al.  Motion pattern analysis using partial trajectories for abnormal movement detection in crowded scenes , 2013 .

[20]  Ivan Laptev,et al.  Density-aware person detection and tracking in crowds , 2011, ICCV.

[21]  Kristen Grauman,et al.  Observe locally, infer globally: A space-time MRF for detecting abnormal activities with incremental updates , 2009, CVPR.

[22]  Vincent Lepetit,et al.  BRIEF: Computing a Local Binary Descriptor Very Fast , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Wen-Hsien Fang,et al.  Video anomaly detection and localization using hierarchical feature representation and Gaussian process regression , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[25]  Nuno Vasconcelos,et al.  Privacy preserving crowd monitoring: Counting people without people models or tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Nuno Vasconcelos,et al.  Anomaly detection in crowded scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[27]  Helbing,et al.  Social force model for pedestrian dynamics. , 1995, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[28]  Cewu Lu,et al.  Abnormal Event Detection at 150 FPS in MATLAB , 2013, 2013 IEEE International Conference on Computer Vision.