Tucker visual search-based hybrid tracking model and Fractional Kohonen Self-Organizing Map for anomaly localization and detection in surveillance videos

ABSTRACT Anomaly detection (AD) in video is a challenging task employed in the intelligent video surveillance applications. This paper presents a technique for localizing and detecting anomalies in surveillance videos by proposing hybrid tracking model and Fractional Kohonen Self-Organizing Map (FKSOM). At first, the objects in the initial frames are detected by extracting the background and comparing with the succeeding frames. Then, a tracking model is developed to track the objects in the frame. Further, the features, such as object shape, speed, energy, correlation, and homogeneity, are extracted in the feature extraction process. Finally, the proposed FKSOM algorithm performs AD by identifying anomalous and normal events in the frame. The performance of the proposed technique is evaluated using the metrics, such as Multiple Object Tracking Precision (MOTP), accuracy, sensitivity, and specificity, where it obtains MOTP of 0.9895 with an average accuracy of 0.9339, the sensitivity of 0.9288 and specificity of 1.

[1]  Paulo Moura Oliveira,et al.  Particle swarm optimization with fractional-order velocity , 2010 .

[2]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[3]  Bernhard Schölkopf,et al.  Support Vector Method for Novelty Detection , 1999, NIPS.

[4]  Christoph H. Lampert,et al.  Beyond sliding windows: Object localization by efficient subwindow search , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Aleksandar Lazarevic,et al.  Outlier Detection with Kernel Density Functions , 2007, MLDM.

[6]  Eleftherios Giovanis,et al.  Application of logit model and self‐organizing maps (SOMs) for the prediction of financial crisis periods in US economy , 2010 .

[7]  David C. Hogg,et al.  Learning the Distribution of Object Trajectories for Event Recognition , 1995, BMVC.

[8]  Xiaoqin Zhang,et al.  Incremental Tensor Subspace Learning and Its Applications to Foreground Segmentation and Tracking , 2011, International Journal of Computer Vision.

[9]  Hongbin Zha,et al.  Learning to Detect Anomalies in Surveillance Video , 2015, IEEE Signal Processing Letters.

[10]  Tieniu Tan,et al.  A system for learning statistical motion patterns , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Christian Bauckhage,et al.  Loveparade 2010: Automatic video analysis of a crowd disaster , 2012, Comput. Vis. Image Underst..

[12]  Nuno M. Fonseca Ferreira,et al.  Introducing the fractional-order Darwinian PSO , 2012, Signal Image Video Process..

[13]  Göran Falkman,et al.  Online Learning and Sequential Anomaly Detection in Trajectories , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  David A. Forsyth,et al.  Video Event Detection: From Subvolume Localization to Spatiotemporal Path Search , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Wotao Yin,et al.  A Block Coordinate Descent Method for Regularized Multiconvex Optimization with Applications to Nonnegative Tensor Factorization and Completion , 2013, SIAM J. Imaging Sci..

[16]  Raja Bala,et al.  Adaptive Sparse Representations for Video Anomaly Detection , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Jie Feng,et al.  Online Learning with Self-Organizing Maps for Anomaly Detection in Crowd Scenes , 2010, 2010 20th International Conference on Pattern Recognition.

[18]  Wen-Hsien Fang,et al.  Gaussian Process Regression-Based Video Anomaly Detection and Localization With Hierarchical Feature Representation , 2015, IEEE Transactions on Image Processing.

[19]  Maria da Graça Marcos,et al.  Some Applications of Fractional Calculus in Engineering , 2010 .

[20]  Chang-Tsun Li,et al.  Video Anomaly Detection With Compact Feature Sets for Online Performance , 2017, IEEE Transactions on Image Processing.

[21]  Jiebo Luo,et al.  Video detection anomaly via low-rank and sparse decompositions , 2012, 2012 Western New York Image Processing Workshop.

[22]  Mubarak Shah,et al.  Learning object motion patterns for anomaly detection and improved object detection , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Wen-Hsien Fang,et al.  Abnormal crowd behavior detection and localization using maximum sub-sequence search , 2013, ARTEMIS '13.

[24]  F. Albregtsen.  Statistical Texture Measures Computed from Gray Level Coocurrence Matrices , 2008 .

[25]  Mahmood Fathy,et al.  Video anomaly detection and localisation based on the sparsity and reconstruction error of auto-encoder , 2016 .

[26]  Ramesh Rajagopalan,et al.  A Genetic Algorithm for Optimizing Background Subtraction Parameters in Computer Vision , 2014 .

[27]  Junsong Yuan,et al.  Sparse reconstruction cost for abnormal event detection , 2011, CVPR 2011.

[28]  Xing Hu,et al.  Video anomaly detection using deep incremental slow feature analysis network , 2016, IET Comput. Vis..

[29]  Arnold Wiliem,et al.  Detecting Uncommon Trajectories , 2008, 2008 Digital Image Computing: Techniques and Applications.

[30]  Hao Li,et al.  Unsupervised video anomaly detection using feature clustering , 2012, IET Signal Process..

[31]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.