MuST-POS: multiscale spatial-temporal 3D atrous-net and PCA guided OC-SVM for crowd panic detection

Crowd panic detection (CPD) is crucial to control crowd disasters. The recent CPD approaches fail to address crowd shape change due to perspective distortion in the frame and across the frames. To this end, we are motivated to design a simple but most effective model known as multiscale spatial-temporal atrous-net and principal component analysis (PCA) guided one-class support vector machine (OC-SVM), i.e., MuST-POS for the CPD. The proposed model utilizes two multiscale atrous-net to extract multiscale spatial and multiscale temporal features to model crowd scenes. Then we adopted PCA to reduce the dimension of the extracted multiscale features and fed them into an OC-SVM for modeling normal crowd scenes. The outliers of the OC-SVM are treated as crowd panic behavior. Three publicly available datasets: the UMN, the MED, and the Pets-2009, are used to show the effectiveness of the proposed MuST-POS. The MuST-POS achieves the detection accuracy of 99.40%, 97.61%, and 98.37% on the UMN, the MED, and the Pets-2009 datasets, respectively, and performs better to recent state-of-the-art approaches.

[1]  Rajeev Srivastava,et al.  AMS-CNN: Attentive multi-stream CNN for video-based crowd counting , 2021, International Journal of Multimedia Information Retrieval.

[2]  Asma Cherif,et al.  DeepROD: a deep learning approach for real-time and online detection of a panic behavior in human crowds , 2021, Machine Vision and Applications.

[3]  Wei Zhang,et al.  Multi-density map fusion network for crowd counting , 2020, Neurocomputing.

[4]  S. Tripathy,et al.  A real-time two-input stream multi-column multi-stage convolution neural network (TIS-MCMS-CNN) for efficient crowd congestion-level analysis , 2020, Multimedia Systems.

[5]  Heyfa Ammar,et al.  Real-time frequency-based detection of a panic behavior in human crowds , 2020, Multimedia Tools and Applications.

[6]  A. Khosla,et al.  Crowd Escape Event Detection via Pooling Features of Optical Flow for Intelligent Video Surveillance Systems , 2019, International Journal of Image, Graphics and Signal Processing.

[7]  Neeta Nain,et al.  Detecting anomalous crowd scenes by oriented Tracklets’ approach in active contour region , 2019, Multimedia Tools and Applications.

[8]  R. Dinesh Jackson Samuel,et al.  Real time violence detection framework for football stadium comprising of big data analysis and deep learning through bidirectional LSTM , 2019, Comput. Networks.

[9]  Hichem Snoussi,et al.  An On-Line and Adaptive Method for Detecting Abnormal Events in Videos Using Spatio-Temporal ConvNet , 2019, Applied Sciences.

[10]  Jimson Mathew,et al.  Autoencoder-based abnormal activity detection using parallelepiped spatio-temporal region , 2018, IET Comput. Vis..

[11]  Heyfa Ammar,et al.  Statistical detection of a panic behavior in crowded scenes , 2018, Machine Vision and Applications.

[12]  Xinmin Zhou,et al.  Learning Multimodal Deep Representations for Crowd Anomaly Event Detection , 2018 .

[13]  Mahmood Fathy,et al.  Deep-Cascade: Cascading 3D Deep Neural Networks for Fast Anomaly Detection and Localization in Crowded Scenes , 2017, IEEE Transactions on Image Processing.

[14]  Yong Haur Tay,et al.  Abnormal Event Detection in Videos using Spatiotemporal Autoencoder , 2017, ISNN.

[15]  Mahmood Fathy,et al.  Deep-anomaly: Fully convolutional neural network for fast anomaly detection in crowded scenes , 2016, Comput. Vis. Image Underst..

[16]  Wei Shen,et al.  Spatial-temporal convolutional neural networks for anomaly detection and localization in crowded scenes , 2016, Signal Process. Image Commun..

[17]  Nicu Sebe,et al.  Learning Deep Representations of Appearance and Motion for Anomalous Event Detection , 2015, BMVC.

[18]  Jean-Luc Dugelay,et al.  Towards crowd density-aware video surveillance applications , 2015, Inf. Fusion.

[19]  Nicu Sebe,et al.  A Prototype Learning Framework Using EMD: Application to Complex Scenes Analysis , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Jing Yu,et al.  A Novel Violent Video Detection Scheme Based on Modified 3D Convolutional Neural Networks , 2019, IEEE Access.