Anomalous Crowd Event Analysis Using Isometric Mapping

Anomalous event detection is one of the important applications in crowd monitoring. The detection of anomalous crowd events requires feature matrix to capture the spatio-temporal information to localize the events and detect the outliers. However, feature matrices often become computationally expensive with large number of features becomes critical for large-scale and real-time video analytics. In this work, we present a fast approach to detect anomalous crowd events and frames. First, to detect anomalous crowd events, the motion features are captured using the optical flow and a feature matrix of motion information is constructed and then subjected to nonlinear dimensionality reduction (NDR) using the Isometric Mapping (ISOMAP). Next, to detect anomalous crowd frames, the method uses four statistical features by dividing the frames into blocks and then calculating the statistical features for the blocks where objects were present. The main focus of this study is to understand the effect of large feature matrix size on detecting the anomalies with respect to computational time. Experiments were conducted on two datasets: (1) Performance Evaluation of Tracking and Surveillance (PETS) 2009 and (2) Melbourne Cricket Ground (MCG) 2011. Experiment results suggest that the ISOMAP NDR reduces the computation time significantly, more than ten times, to detect anomalous crowd events and frames. In addition, the experiment revealed that the ISOMAP provided an upper bound on the computational time.

[1]  Zhenjiang Miao,et al.  Anomaly detection in crowd scene , 2010, IEEE 10th INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS.

[2]  Sergio A. Velastin,et al.  Intelligent distributed surveillance systems: a review , 2005 .

[3]  Robert M. Hawlick.  Statistical and Structural Approaches to Texture , 1979 .

[4]  Kejun Wang,et al.  Video-Based Abnormal Human Behavior Recognition—A Review , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[5]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[6]  Nuno Vasconcelos,et al.  Anomaly detection in crowded scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Michael C. Hout,et al.  Multidimensional Scaling , 2003, Encyclopedic Dictionary of Archaeology.

[8]  Edward J. Delp,et al.  Crowd flow estimation using multiple visual features for scenes with changing crowd densities , 2011, 2011 8th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[9]  Marimuthu Palaniswami,et al.  Detection of Anomalous Crowd Behaviour Using Hyperspherical Clustering , 2014, 2014 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[10]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[11]  R.M. Haralick,et al.  Statistical and structural approaches to texture , 1979, Proceedings of the IEEE.

[12]  Fei-Fei Li,et al.  Online detection of unusual events in videos via dynamic sparse coding , 2011, CVPR 2011.

[13]  Duan-Yu Chen,et al.  Dynamic human crowd modeling and its application to anomalous events detcetion , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[14]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[15]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[16]  Ehud Rivlin,et al.  Robust Real-Time Unusual Event Detection using Multiple Fixed-Location Monitors , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Marimuthu Palaniswami,et al.  Estimation of crowd density by clustering motion cues , 2014, The Visual Computer.

[18]  Anil K. Jain,et al.  Unsupervised Learning of Finite Mixture Models , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  T. Kohonen.  Self-organized formation of topographically correct feature maps , 1982 .

[20]  H. Hotelling.  Analysis of a complex of statistical variables into principal components. , 1933 .

[21]  W. Torgerson.  Multidimensional scaling: I. Theory and method , 1952 .

[22]  Jinhai Xiang,et al.  An Abnormal Event Recognition in Crowd Scene , 2011, 2011 Sixth International Conference on Image and Graphics.

[23]  Marimuthu Palaniswami,et al.  Hyperspherical cluster based distributed anomaly detection in wireless sensor networks , 2014, J. Parallel Distributed Comput..

[24]  Dorothy Ndedi Monekosso,et al.  Learning Video Manifold for Segmenting Crowd Events and Abnormality Detection , 2010, ACCV.

[25]  D. Donoho,et al.  Hessian eigenmaps: Locally linear embedding techniques for high-dimensional data , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[26]  Andrea Cavallaro,et al.  Event monitoring via local motion abnormality detection in non-linear subspace , 2010, Neurocomputing.

[27]  M. Palaniswami,et al.  Distributed Anomaly Detection in Wireless Sensor Networks , 2006, 2006 10th IEEE Singapore International Conference on Communication Systems.

[28]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.