Associating Moving Objects Across Non-overlapping Cameras: A Query-by-Example Approach

In this paper we present a query by example approach for tracking people across non overlapping cameras. The method proposed is based on the use of a multi-dimensional feature vector and its covariance, defining an appearance model of every detected moving region in the network of cameras. The model uses relative pixel position, color and gradients descriptors of each detected object. Association of objects across non-overlapping cameras is performed by matching appearance of selected object with past observations. Availability of tracking within every camera can further improve the accuracy of such association by matching several targets appearance models with detected regions. For this purpose we present an automatic clustering technique allowing to build a multi-valued appearance model from a collection of covariance matrices. The proposed approach does not require geometric or colorimetric calibration of the cameras. We will illustrate the method for tracking people and objects in relatively crowded indoor scenes.

[1]  Gérard G. Medioni,et al.  Multiple Target Tracking Using Spatio-Temporal Markov Chain Monte Carlo Data Association , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  W. Förstner,et al.  A Metric for Covariance Matrices , 2003 .

[3]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[4]  Fatih Murat Porikli,et al.  Region Covariance: A Fast Descriptor for Detection and Classification , 2006, ECCV.

[5]  David G. Stork,et al.  Pattern Classification , 1973 .

[6]  Tele Tan,et al.  Non-overlapping Distributed Tracking using Particle Filter , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[7]  Fatih Murat Porikli,et al.  Human Detection via Classification on Riemannian Manifolds , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Ting Liu,et al.  Clustering Billions of Images with Large Scale Nearest Neighbor Search , 2007, 2007 IEEE Workshop on Applications of Computer Vision (WACV '07).

[9]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[10]  Gérard G. Medioni,et al.  Continuous tracking within and across camera streams , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[11]  Günter Rote,et al.  Computing the Minimum Hausdorff Distance Between Two Point Sets on a Line Under Translation , 1991, Inf. Process. Lett..

[12]  Anil K. Jain,et al.  ViSE: Visual Search Engine Using Multiple Networked Cameras , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[13]  Marc Parizeau,et al.  MONNET: Monitoring Pedestrians with a Network of Loosely-Coupled Cameras , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[14]  David Nistér,et al.  Scalable Recognition with a Vocabulary Tree , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[15]  Tryphon Lambrou,et al.  Principal Geodesic Analysis for the Study of Nonlinear Minimum Description Length , 2007, MIMI.