Particle Filter-Based Prediction for Anomaly Detection in Automatic Surveillance

Automatic surveillance of abnormal events is a major unsolved problem in city management. By successful implementation of automatic surveillance of abnormal events, a significant amount of human resources in video monitoring can be economized. One solution to this application is computer vision technology. This approach utilizes an image processing algorithm to extract specific features and then uses discriminator algorithms to give an alert. In this paper, we propose to apply a particle filter-based algorithm to feature series extracted from videos in order to give alerts when abnormal events occur. The whole process consists of feature series generation and particle filter tracking. To represent the features of a video, an L2-norm extractor is designed based on the optical flow. Then, the particle filter keeps track of these feature series. The occurrence of abnormal events will cause the shift of feature series and a large error in PF tracking. This, in turn, will allow computers to understand and define the occurrences of anomalies. Experiments on UMN dataset show that our algorithm reaches 90% accuracy in frame-level detection.

[1]  Rudolph van der Merwe,et al.  The unscented Kalman filter for nonlinear estimation , 2000, Proceedings of the IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium (Cat. No.00EX373).

[2]  B. Mukherjee,et al.  Analysis of a prediction-based mobility adaptive tracking algorithm , 2005, 2nd International Conference on Broadband Networks, 2005..

[3]  Hai Zhao,et al.  A optimized particle filter based on PSO algorithm , 2009, 2009 International Conference on Future BioMedical Information Engineering (FBIE).

[4]  Fei-Fei Li,et al.  Online detection of unusual events in videos via dynamic sparse coding , 2011, CVPR 2011.

[5]  Shenghua Gao,et al.  Future Frame Prediction for Anomaly Detection - A New Baseline , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[6]  Junsong Yuan,et al.  Abnormal event detection in crowded scenes using sparse representation , 2013, Pattern Recognit..

[7]  David A. Clausi,et al.  Goal-based trajectory analysis for unusual behaviour detection in intelligent surveillance , 2011, Image Vis. Comput..

[8]  Gunnar Farnebäck,et al.  Two-Frame Motion Estimation Based on Polynomial Expansion , 2003, SCIA.

[9]  Fasheng Wang,et al.  An ant particle filter for visual tracking , 2017, 2017 IEEE/ACIS 16th International Conference on Computer and Information Science (ICIS).

[10]  Zhiwen Yu,et al.  A Bayesian Model for Crowd Escape Behavior Detection , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  W. Marsden I and J , 2012 .

[12]  Subhas Chandra Mukhopadhyay,et al.  Wearable Sensors for Human Activity Monitoring: A Review , 2015, IEEE Sensors Journal.

[13]  Ramin Mehran,et al.  Abnormal crowd behavior detection using social force model , 2009, CVPR.

[14]  Jonghyun Choi,et al.  Learning Temporal Regularity in Video Sequences , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Hang-Bong Kang,et al.  Abnormal behavior detection using hybrid agents in crowded scenes , 2014, Pattern Recognit. Lett..

[16]  Damla Arifoglu,et al.  Activity Recognition and Abnormal Behaviour Detection with Recurrent Neural Networks , 2017, FNC/MobiSPC.

[17]  Yann LeCun,et al.  Deep multi-scale video prediction beyond mean square error , 2015, ICLR.

[18]  R. Vidal,et al.  Histograms of oriented optical flow and Binet-Cauchy kernels on nonlinear dynamical systems for the recognition of human actions , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Simon J. Godsill,et al.  Particle methods for Bayesian modeling and enhancement of speech signals , 2002, IEEE Trans. Speech Audio Process..

[20]  Cewu Lu,et al.  Abnormal Event Detection at 150 FPS in MATLAB , 2013, 2013 IEEE International Conference on Computer Vision.

[21]  Wu Son Method of real-time traffic statistics using mobile network signaling , 2014 .

[22]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[23]  Mubarak Shah,et al.  Chaotic invariants of Lagrangian particle trajectories for anomaly detection in crowded scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[24]  Mubarak Shah,et al.  Real-World Anomaly Detection in Surveillance Videos , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[25]  Tian Wang,et al.  Histograms of optical flow orientation for abnormal events detection , 2013, 2013 IEEE International Workshop on Performance Evaluation of Tracking and Surveillance (PETS).

[26]  Changsheng Xu,et al.  Correlation Particle Filter for Visual Tracking , 2018, IEEE Transactions on Image Processing.

[27]  Thomas Brox,et al.  FlowNet: Learning Optical Flow with Convolutional Networks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).