Anomaly Detection via Local Coordinate Factorization and Spatio-Temporal Pyramid

Anomaly detection, which aims to discover anomalous events, defined as having a low likelihood of occurrence, from surveillance videos, has attracted increasing interest and is still a challenge in computer vision community. In this paper, we propose an efficient anomaly detection approach which can perform both real-time and multi-scale detection. Our approach can handle the change of background. Specifically, Local Coordinate Factorization is utilized to tell whether a spatio-temporal video volume (STV) belongs to an anomaly, which can effectively detect spatial, temporal and spatio-temporal anomalies. And we employ Spatio-temporal Pyramid (STP) to capture the spatial and temporal continuity of an anomalous event, enabling our approach to handle multi-scale and complicated events. We also propose an online method to update the local coordinates, which makes our approach self-adaptive to background change which typically occurs in real-world setting. We conduct extensive experiments on several publicly available datasets for anomaly detection, and the results show that our approach can outperform state-of-the-art approaches, which verifies the effectiveness of our approach.

[1]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[2]  Brian C. Lovell,et al.  Improved anomaly detection in crowded scenes via cell-based analysis of foreground speed, size and texture , 2011, CVPR 2011 WORKSHOPS.

[3]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[4]  Larry S. Davis,et al.  Real-time foreground-background segmentation using codebook model , 2005, Real Time Imaging.

[5]  Shaogang Gong,et al.  Video Behaviour Mining Using a Dynamic Topic Model , 2011, International Journal of Computer Vision.

[6]  Kristen Grauman,et al.  Observe locally, infer globally: A space-time MRF for detecting abnormal activities with incremental updates , 2009, CVPR.

[7]  Mohan M. Trivedi,et al.  Trajectory Learning for Activity Understanding: Unsupervised, Multilevel, and Long-Term Adaptive Approach , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Aggelos K. Katsaggelos,et al.  A Dynamic Hierarchical Clustering Method for Trajectory-Based Unusual Video Event Detection , 2009, IEEE Transactions on Image Processing.

[9]  Xudong Zhu,et al.  Human behavior clustering for anomaly detection , 2011, Frontiers of Computer Science in China.

[10]  Ramin Mehran,et al.  Abnormal crowd behavior detection using social force model , 2009, CVPR.

[11]  Lars Niklasson,et al.  Approaches for detecting behavioural anomalies in public areas using video surveillance data , 2008, Security + Defence.

[12]  Michal Irani,et al.  Detecting Irregularities in Images and in Video , 2005, ICCV.

[13]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[14]  Shaogang Gong,et al.  Learning Behavioural Context , 2012, International Journal of Computer Vision.

[15]  Yihong Gong,et al.  Nonlinear Learning using Local Coordinate Coding , 2009, NIPS.

[16]  Junsong Yuan,et al.  Sparse reconstruction cost for abnormal event detection , 2011, CVPR 2011.

[17]  Alberto Del Bimbo,et al.  Multi-scale and real-time non-parametric approach for anomaly detection and localization , 2012, Comput. Vis. Image Underst..

[18]  Christophe Rosenberger,et al.  Abnormal events detection based on spatio-temporal co-occurences , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Samy Bengio,et al.  Semi-supervised adapted HMMs for unusual event detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[20]  Yihong Gong,et al.  Locality-constrained Linear Coding for image classification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Martin D. Levine,et al.  A Multi-Scale Hierarchical Codebook Method for Human Action Recognition in Videos Using a Single Example , 2012, 2012 Ninth Conference on Computer and Robot Vision.

[22]  Shaogang Gong,et al.  Detecting and discriminating behavioural anomalies , 2011, Pattern Recognit..

[23]  Shaogang Gong,et al.  On-the-fly global activity prediction and anomaly detection , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[24]  P. L. Venetianer,et al.  The evolution of video surveillance: an overview , 2008, Machine Vision and Applications.

[25]  Aggelos K. Katsaggelos,et al.  Anomalous video event detection using spatiotemporal context , 2011 .

[26]  Venkatesh Saligrama,et al.  Video anomaly detection based on local statistical aggregates , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Venkatesh Saligrama,et al.  Abnormality detection using low-level co-occurring events , 2011, Pattern Recognit. Lett..

[28]  Matthew N. Dailey,et al.  Incremental behavior modeling and suspicious activity detection , 2013, Pattern Recognit..

[29]  Venkatesh Saligrama,et al.  Motion segmentation and abnormal behavior detection via behavior clustering , 2008, 2008 15th IEEE International Conference on Image Processing.

[30]  Mubarak Shah,et al.  A 3-dimensional sift descriptor and its application to action recognition , 2007, ACM Multimedia.

[31]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[32]  Nuno Vasconcelos,et al.  Anomaly detection in crowded scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[33]  Frederic Dufaux,et al.  Towards Generic Detection of Unusual Events in Video Surveillance , 2003, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[34]  Shehzad Khalid,et al.  Activity classification and anomaly detection using m-mediods based modelling of motion patterns , 2010, Pattern Recognit..

[35]  Louis Kratz,et al.  Anomaly detection in extremely crowded scenes using spatio-temporal motion pattern models , 2009, CVPR.

[36]  Xiaojun Wu,et al.  Graph Regularized Nonnegative Matrix Factorization for Data Representation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Martin D. Levine,et al.  Online Dominant and Anomalous Behavior Detection in Videos , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Andrei Zaharescu,et al.  Anomalous Behaviour Detection Using Spatiotemporal Oriented Energies, Subset Inclusion Histogram Comparison and Event-Driven Processing , 2010, ECCV.

[39]  Tao Xiang,et al.  Identifying Rare and Subtle Behaviors: A Weakly Supervised Joint Topic Model , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Rowland R. Sillito Incremental semi-supervised learning for anomalous trajectory detection , 2010 .

[41]  Nikos Paragios,et al.  Scene modeling and change detection in dynamic scenes: A subspace approach , 2009, Comput. Vis. Image Underst..

[42]  Venkatesh Saligrama,et al.  Behavior Subtraction , 2012, IEEE Transactions on Image Processing.

[43]  Chih-Jen Lin,et al.  On the Convergence of Multiplicative Update Algorithms for Nonnegative Matrix Factorization , 2007, IEEE Transactions on Neural Networks.

[44]  Nicu Sebe,et al.  A Prototype Learning Framework Using EMD: Application to Complex Scenes Analysis , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Martina Angela Sasse,et al.  “Not the Usual Suspects”: A study of factors reducing the effectiveness of CCTV , 2008 .

[46]  Venkatesh Saligrama,et al.  Modeling background activity for behavior subtraction , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[47]  Lars Niklasson,et al.  Finding behavioural anomalies in public areas using video surveillance data , 2008, 2008 11th International Conference on Information Fusion.

[48]  Y. Nesterov Gradient methods for minimizing composite objective function , 2007 .

[49]  Chang Liu,et al.  Anomaly detection in surveillance video using motion direction statistics , 2010, 2010 IEEE International Conference on Image Processing.

[50]  T. Troscianko,et al.  What Happens Next? The Predictability of Natural Behaviour Viewed through CCTV Cameras , 2004, Perception.

[51]  Ehud Rivlin,et al.  Robust Real-Time Unusual Event Detection using Multiple Fixed-Location Monitors , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.