Semantic browsing of video surveillance databases through Online Generic Indexing

This paper gives a thorough overview of EADS UrbanVIEW indexing and mining platform aimed at providing police forces and security officers with advanced tools to efficiently browse large video surveillance databases for investigation purposes. A scalable indexing architecture that works indifferently with smart or classical camera networks as well as for real-time or a posteriori indexing has been designed and implemented. We introduce the concept of Online Generic Indexing Strategy (OGIS) aimed at systematically enriching each video stream with real-time extracted generic metadata allowing to dramatically decrease post-event investigation time. The indexing strategy relies on the systematic detection, tracking and characterization of all observed moving objects. Semantic and non semantic metadata produced by embedded or distributed video analytics modules can be used either to browse the distributed video databases or as inputs to higher level characterization modules (object identification, multi-camera back-tracking, event recognition…). Once a first observation of an object of interest has been found, it can be forward and backward tracked thanks to an interactive multi-stream player taking into account the multi-camera context. Our platform has been assessed on the NGSIM and I-LIDS datasets which consist of real heavy traffic images, showing both high recall and high detection rates in its retrieval capabilities.

[1]  Larry S. Davis,et al.  Mining tools for surveillance video , 2003, IS&T/SPIE Electronic Imaging.

[2]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[3]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[5]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[6]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[7]  K. P. Chow,et al.  Object-Based Surveillance Video Retrieval System with Real-Time Indexing Methodology , 2007, ICIAR.

[8]  Stephen J. Maybank,et al.  The ADVISOR Visual Surveillance System , 2004 .

[9]  Venkatesh Saligrama,et al.  Abnormal behavior detection and behavior matching for networked cameras , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[10]  François Brémond,et al.  A framework for surveillance video indexing and retrieval , 2008, 2008 International Workshop on Content-Based Multimedia Indexing.

[11]  K. S. Venkatesh,et al.  Surveillance Video Mining , 2007 .

[12]  K. S. Venkatesh,et al.  Occlusion Sequence Mining for Activity Discovery from Surveillance Videos , 2008 .

[13]  Maria Valera Espina,et al.  An approach for designing a real-time intelligent distributed surveillance system , 2006 .

[14]  Gian Luca Foresti,et al.  Trajectory-Based Anomalous Event Detection , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  François Brémond,et al.  A Query Language Combining Object Features and Semantic Events for Surveillance Video Retrieval , 2008, MMM.

[16]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[17]  Rogério Schmidt Feris,et al.  Searching surveillance video , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.