Kernel null-space-based abnormal event detection using hybrid motion information

Abstract. Abnormal event detection in crowded scenes is a challenging task in the computer vision community. A hybrid motion descriptor named the multiscale histogram of first- and second-order motion is proposed for abnormal event detection. The second-order motion describes the change in motion and is extracted by optical flow-based instantaneous tracking, which avoids object tracking in crowded scenes. For the modeling of normal events, a kernel null Foley–Sammon transform (KNFST) is introduced. KNFST makes a projection in the null space, where normal samples of all types are treated jointly instead of considering each known class individually. Experiments conducted on two benchmark datasets and comparisons to state-of-the-art methods demonstrate the superiority of the proposed method.

[1]  Junsong Yuan,et al.  Abnormal event detection in crowded scenes using sparse representation , 2013, Pattern Recognit..

[2]  Junsong Yuan,et al.  Sparse reconstruction cost for abnormal event detection , 2011, CVPR 2011.

[3]  Ehud Rivlin,et al.  Robust Real-Time Unusual Event Detection using Multiple Fixed-Location Monitors , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  P. Angelov,et al.  A fast approach to novelty detection in video streams using recursive density estimation , 2008, 2008 4th International IEEE Conference Intelligent Systems.

[5]  Ramin Mehran,et al.  Abnormal crowd behavior detection using social force model , 2009, CVPR.

[6]  Joachim Denzler,et al.  Kernel Null Space Methods for Novelty Detection , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Alberto Del Bimbo,et al.  Multi-scale and real-time non-parametric approach for anomaly detection and localization , 2012, Comput. Vis. Image Underst..

[8]  Xiangyang Xue,et al.  Null Foley-Sammon transform , 2006, Pattern Recognit..

[9]  Naixue Xiong,et al.  Abnormal event detection in crowded scenes based on deep learning , 2016, Multimedia Tools and Applications.

[10]  Shiqiang Hu,et al.  Anomaly Detection Based on Local Nearest Neighbor Distance Descriptor in Crowded Scenes , 2014, TheScientificWorldJournal.

[11]  Sridha Sridharan,et al.  Textures of optical flow for real-time anomaly detection in crowds , 2011, 2011 8th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[12]  Edward H. Adelson,et al.  Human-assisted motion annotation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Nuno Vasconcelos,et al.  Anomaly detection in crowded scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Gian Luca Foresti,et al.  Trajectory-Based Anomalous Event Detection , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Qixiang Ye,et al.  Visual abnormal behavior detection based on trajectory sparse reconstruction analysis , 2013, Neurocomputing.

[16]  Changsheng Li,et al.  Sparse representation for robust abnormality detection in crowded scenes , 2014, Pattern Recognit..

[17]  John W. Sammon,et al.  An Optimal Set of Discriminant Vectors , 1975, IEEE Transactions on Computers.

[18]  Bernhard Schölkopf,et al.  Support Vector Method for Novelty Detection , 1999, NIPS.

[19]  Ye Tao,et al.  Abnormal crowd motion detection using double sparse representation , 2017, Neurocomputing.

[20]  Ákos Utasi,et al.  Detection of unusual optical flow patterns by multilevel hidden Markov models , 2010 .

[21]  Palaiahnakote Shivakumara,et al.  Anomaly Detection through Spatio-temporal Context Modeling in Crowded Scenes , 2014, 2014 22nd International Conference on Pattern Recognition.

[22]  Brian C. Lovell,et al.  Improved anomaly detection in crowded scenes via cell-based analysis of foreground speed, size and texture , 2011, CVPR 2011 WORKSHOPS.

[23]  R. Vidal,et al.  Histograms of oriented optical flow and Binet-Cauchy kernels on nonlinear dynamical systems for the recognition of human actions , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Louis Kratz,et al.  Anomaly detection in extremely crowded scenes using spatio-temporal motion pattern models , 2009, CVPR.

[25]  Wei Shen,et al.  Unusual event detection in crowded scenes by trajectory analysis , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[26]  Aggelos K. Katsaggelos,et al.  A Dynamic Hierarchical Clustering Method for Trajectory-Based Unusual Video Event Detection , 2009, IEEE Transactions on Image Processing.

[27]  Mubarak Shah,et al.  Probabilistic Modeling of Scene Dynamics for Applications in Visual Surveillance , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Qi Wang,et al.  Online Anomaly Detection in Crowd Scenes via Structure Analysis , 2015, IEEE Transactions on Cybernetics.

[29]  Hichem Snoussi,et al.  Detection of Abnormal Visual Events via Global Optical Flow Orientation Histogram , 2014, IEEE Transactions on Information Forensics and Security.

[30]  Paolo Remagnino,et al.  Laplacian Eigenmap With Temporal Constraints for Local Abnormality Detection in Crowded Scenes , 2013, IEEE Transactions on Cybernetics.

[31]  Imran N. Junejo,et al.  Social network model for crowd anomaly detection and localization , 2017, Pattern Recognit..

[32]  Wei Shen,et al.  Spatial-temporal convolutional neural networks for anomaly detection and localization in crowded scenes , 2016, Signal Process. Image Commun..

[33]  Mubarak Shah,et al.  Chaotic invariants of Lagrangian particle trajectories for anomaly detection in crowded scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[34]  Yandong Tang,et al.  Video Anomaly Search in Crowded Scenes via Spatio-Temporal Motion Context , 2013, IEEE Transactions on Information Forensics and Security.

[35]  Qing Zhang,et al.  Saliency-based abnormal event detection in crowded scenes , 2016, J. Electronic Imaging.

[36]  Yu'e Lin,et al.  Kernel Null Foley-Sammon Transform , 2008, 2008 International Conference on Computer Science and Software Engineering.