Particle-based tracking model for automatic anomaly detection

In this paper, we present a new method to automatically discover recurrent activities occurring in a video scene, and to identify the temporal relations between these activities, e.g. to discover the different flows of cars at a road intersection, and to identify the traffic light sequence that governs these flows. The proposed method is based on particle-based trajectories, analyzed through a cascade of HMM and HDP-HMM models. We demonstrate the effectiveness of our model for scene activity recognition task on a road intersection dataset. We last show that our model is also able to perform on the fly abnormal events detection (by identifying activities or relations that do not fit in the usual/discovered ones), with encouraging performances.

[1]  Carl E. Rasmussen,et al.  Factorial Hidden Markov Models , 1997 .

[2]  Jean-Marc Odobez,et al.  A Sparsity Constraint for Topic Models - Application to Temporal Activity Mining , 2010, NIPS 2010.

[3]  Luc Van Gool,et al.  What's going on? Discovering spatio-temporal dependencies in dynamic scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Shaogang Gong,et al.  From Local Temporal Correlation to Global Anomaly Detection , 2008 .

[5]  Jean-Marc Odobez,et al.  Understanding metro station usage using Closed Circuit TeleVision cameras analysis , 2008, 2008 11th International IEEE Conference on Intelligent Transportation Systems.

[6]  Mubarak Shah,et al.  Learning object motion patterns for anomaly detection and improved object detection , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Mubarak Shah,et al.  Probabilistic Modeling of Scene Dynamics for Applications in Visual Surveillance , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Jean-Marc Odobez,et al.  Topic models for scene analysis and abnormality detection , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[9]  Alin Achim,et al.  18th IEEE International Conference on Image Processing, ICIP 2011, Brussels, Belgium, September 11-14, 2011 , 2011, ICIP.

[10]  Frederic Dufaux,et al.  Towards Generic Detection of Unusual Events in Video Surveillance , 2003, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[11]  W. Eric L. Grimson,et al.  Learning Semantic Scene Models by Trajectory Analysis , 2006, ECCV.

[12]  Shaogang Gong,et al.  A Markov Clustering Topic Model for mining behaviour in video , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[13]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[14]  Svetha Venkatesh,et al.  Activity recognition and abnormality detection with the switching hidden semi-Markov model , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).