Localized anomaly detection via hierarchical integrated activity discovery

With the increasing number and variety of camera installations, unsupervised methods that learn typical activities have become popular for anomaly detection. In this article, we consider recent methods based on temporal probabilistic models and improve them in multiple ways. Our contributions are the following: (i) we integrate the low level processing and the temporal activity modeling, showing how this feedback improves the overall quality of the captured information, (ii) we show how the same approach can be taken to do hierarchical multi-camera processing, (iii) we use spatial analysis of the anomalies both to perform local anomaly detection and to frame automatically the detected anomalies. We illustrate the approach on both traffic data and videos coming from a metro station.

[1]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[2]  Andrea Cavallaro,et al.  Trajectory Association and Fusion across Partially Overlapping Cameras , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[3]  Venugopal V. Veeravalli,et al.  Multihypothesis sequential probability ratio tests - Part II: Accurate asymptotic expansions for the expected sample size , 2000, IEEE Trans. Inf. Theory.

[4]  Simone Calderara,et al.  Detecting anomalies in people's trajectories using spectral graph analysis , 2011, Comput. Vis. Image Underst..

[5]  Shaogang Gong,et al.  A Markov Clustering Topic Model for mining behaviour in video , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[6]  David M. Blei,et al.  Probabilistic topic models , 2012, Commun. ACM.

[7]  Senem Velipasalar,et al.  Real-time distributed tracking with non-overlapping cameras , 2010, 2010 IEEE International Conference on Image Processing.

[8]  Andrzej Cichocki,et al.  Kernel nonnegative matrix factorization for spectral EEG feature extraction , 2009, Neurocomputing.

[9]  E Donchin,et al.  Brain-computer interface technology: a review of the first international meeting. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[10]  S. Gong,et al.  Global Abnormal Behaviour Detection Using a Network of CCTV Cameras , 2008 .

[11]  Annamalai Natarajan,et al.  Reliable identification of mental tasks using time-embedded EEG and sequential evidence accumulation , 2011, Journal of neural engineering.

[12]  Jean-Marc Odobez,et al.  Probabilistic Latent Sequential Motifs: Discovering Temporal Activity Patterns in Video Scenes , 2010, BMVC.

[13]  François Brémond,et al.  Design and Assessment of an Intelligent Activity Monitoring Platform , 2005, EURASIP J. Adv. Signal Process..

[14]  Charles W. Anderson,et al.  Classification of EEG during imagined mental tasks by forecasting with Elman Recurrent Neural Networks , 2011, The 2011 International Joint Conference on Neural Networks.

[15]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[16]  Jean-Marc Odobez,et al.  Multi-camera open space human activity discovery for anomaly detection , 2011, 2011 8th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[17]  Jean-Marc Odobez,et al.  Topic models for scene analysis and abnormality detection , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[18]  Richard A. Harshman,et al.  Indexing by Latent Semantic Analysis , 1990, J. Am. Soc. Inf. Sci..

[19]  Thomas Hofmann,et al.  Probabilistic Latent Semantic Analysis , 1999, UAI.

[20]  Plamen Manoilov,et al.  Eye-blinking artefacts analysis , 2007, CompSysTech '07.

[21]  Cyril Carincotte,et al.  Particle-based tracking model for automatic anomaly detection , 2011, 2011 18th IEEE International Conference on Image Processing.

[22]  Cyril Carincotte,et al.  Mono versus Multi-view tracking-based model for automatic scene activity modeling and anomaly detection , 2011, 2011 8th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[23]  Gregor Heinrich Parameter estimation for text analysis , 2009 .

[24]  T. Sejnowski,et al.  Removal of eye activity artifacts from visual event-related potentials in normal and clinical subjects , 2000, Clinical Neurophysiology.

[25]  K. Lempert,et al.  CONDENSED 1,3,5-TRIAZEPINES - IV THE SYNTHESIS OF 2,3-DIHYDRO-1H-IMIDAZO-[1,2-a] [1,3,5] BENZOTRIAZEPINES , 1983 .

[26]  Jean-Marc Odobez,et al.  Bridging the past, present and future: Modeling scene activities from event relationships and global rules , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Luc Van Gool,et al.  What's going on? Discovering spatio-temporal dependencies in dynamic scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[28]  David M. Blei,et al.  Introduction to Probabilistic Topic Models , 2010 .

[29]  Shaogang Gong,et al.  Multi-camera activity correlation analysis , 2009, CVPR.

[30]  Jean-Marc Odobez,et al.  A Sequential Topic Model for Mining Recurrent Activities from Long Term Video Logs , 2013, International Journal of Computer Vision.