Multi-camera open space human activity discovery for anomaly detection

We address the discovery of typical activities in video stream contents and its exploitation for estimating the abnormality levels of these streams. Such estimates can be used to select the most interesting cameras to show to a human operator. Our contributions come from the following facets: i) the method is fully unsupervised and learns the activities from long term data; ii) the method is scalable and can efficiently handle the information provided by multiple un-calibrated cameras, jointly learning activities shared by them if it happens to be the case (e.g. when they have overlapping fields of view); iii) unlike previous methods which were mainly applied to structured urban traffic scenes, we show that ours performs well on videos from a metro environment where human activities are only loosely constrained.

[1]  Jean-Marc Odobez,et al.  Probabilistic Latent Sequential Motifs: Discovering Temporal Activity Patterns in Video Scenes , 2010, BMVC.

[2]  François Brémond,et al.  Design and Assessment of an Intelligent Activity Monitoring Platform , 2005, EURASIP J. Adv. Signal Process..

[3]  Cyril Carincotte,et al.  Particle-based tracking model for automatic anomaly detection , 2011, 2011 18th IEEE International Conference on Image Processing.

[4]  Michael I. Jordan,et al.  Hierarchical Dirichlet Processes , 2006 .

[5]  Luc Van Gool,et al.  What's going on? Discovering spatio-temporal dependencies in dynamic scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  S. Gong,et al.  Global Abnormal Behaviour Detection Using a Network of CCTV Cameras , 2008 .

[7]  W. Eric L. Grimson,et al.  Correspondence-free multi-camera activity analysis and scene modeling , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Andrea Cavallaro,et al.  Trajectory Association and Fusion across Partially Overlapping Cameras , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[9]  Shaogang Gong,et al.  Multi-camera activity correlation analysis , 2009, CVPR.

[10]  Lifeng Sun,et al.  A Sequential Monte Carlo Approach to Anomaly Detection in Tracking Visual Events , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Senem Velipasalar,et al.  Real-time distributed tracking with non-overlapping cameras , 2010, 2010 IEEE International Conference on Image Processing.