Appearance based retrieval for tracked objects in surveillance videos

This paper focuses on indexing and retrieval at the object level for video surveillance. Object retrieval is difficult due to imprecise object detection and tracking. In the indexing phase, a new representative blob detection method allows to choose the most relevant blobs that represent various object's visual aspects. In the retrieval phase, a new robust object matching method retrieves successfully objects even though they are not perfectly tracked. We validate our approach thanks to videos coming from a subway monitoring project. The representative blob detection method improves the state of the art. The obtained retrieval results show that the object matching method is robust while working with imprecise object tracking algorithms.

[1]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[2]  Monique Thonnat,et al.  Subtrajectory-Based Video Indexing and Retrieval , 2007, MMM.

[3]  Lisa M. Brown,et al.  Detection of user-defined, semantically high-level, composite events, and retrieval of event queries , 2010, Multimedia Tools and Applications.

[4]  François Brémond,et al.  A Query Language Combining Object Features and Semantic Events for Surveillance Video Retrieval , 2008, MMM.

[5]  Lei Chen,et al.  Symbolic representation and retrieval of moving object trajectories , 2004, MIR '04.

[6]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[7]  François Brémond,et al.  ETISEO, performance evaluation for video surveillance systems , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[8]  Francesco G. B. De Natale,et al.  Object Trajectory Analysis in Video Indexing and Retrieval Applications , 2010, Video Search and Mining.

[9]  Monique Thonnat,et al.  FAST AND RELIABLE OBJECT CLASSIFICATION IN VIDEO BASED ON A 3D GENERIC MODEL , 2006 .

[10]  Slawomir Bak,et al.  Person Re-identification Using Spatial Covariance Regions of Human Body Parts , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[11]  Thierry Pun,et al.  The Truth about Corel - Evaluation in Image Retrieval , 2002, CIVR.

[12]  Jun-Wei Hsieh,et al.  Motion-based video retrieval by trajectory matching , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Andrew W. Senior,et al.  An Introduction to Automatic Video Surveillance , 2009, Protecting Privacy in Video Surveillance.

[14]  Qi Tian,et al.  Semantic retrieval of video - review of research on video retrieval in meetings, movies and broadcast news, and sports , 2006, IEEE Signal Processing Magazine.

[15]  Monique Thonnat,et al.  AN INTERFACE FOR IMAGE RETRIEVAL AND ITS EXTENSION TO VIDEO RETRIEVAL , 2006 .

[16]  A. Bertran,et al.  Face Detection Project Report , 2002 .

[17]  François Brémond,et al.  Surveillance Video Indexing and Retrieval Using Object Features and Semantic Events , 2009, Int. J. Pattern Recognit. Artif. Intell..

[18]  Leonidas J. Guibas,et al.  A metric for distributions with applications to image databases , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[19]  C. Won,et al.  Efficient Use of MPEG‐7 Edge Histogram Descriptor , 2002 .

[20]  Maike Buchin,et al.  An algorithmic framework for segmenting trajectories based on spatio-temporal criteria , 2010, GIS '10.

[21]  G. Lieberman,et al.  Introduction to Mathematical Programming , 1990 .

[22]  Monique Thonnat,et al.  Surveillance video retrieval: what we have already done? , 2010, ICC 2010.

[23]  R. Cucchiara,et al.  Multimedia surveillance: content-based retrieval with multicamera people tracking , 2006, VSSN '06.

[24]  Yunqian Ma,et al.  Associating Moving Objects Across Non-overlapping Cameras: A Query-by-Example Approach , 2008, 2008 IEEE Conference on Technologies for Homeland Security.

[25]  Zhouyu Fu,et al.  Semantic-Based Surveillance Video Retrieval , 2007, IEEE Transactions on Image Processing.

[26]  Wei-bang Chen,et al.  Semantic retrieval of events from indoor surveillance video databases , 2009, Pattern Recognit. Lett..

[27]  Ben Miller,et al.  Video Sequence Querying Using Clustering of Objects' Appearance Models , 2007, ISVC.

[28]  N. Paragios,et al.  Video-Based Surveillance Systems: Computer Vision and Distributed Processing , 2001 .

[29]  K. P. Chow,et al.  Object-Based Surveillance Video Retrieval System with Real-Time Indexing Methodology , 2007, ICIAR.