Incremental, scalable tracking of objects inter camera

This paper presents a scalable solution to the problem of tracking objects across spatially separated, uncalibrated cameras with non overlapping fields of view. The approach relies on the three cues of colour, relative size and movement between cameras to describe the relationship of objects between cameras. This relationship weights the observation likelihood for correlating or tracking objects between cameras. Any individual cue alone has poor performance, but when fused together, a large boost in accuracy is gained. Unlike previous work, this paper uses an incremental technique to learning. The three cues are learnt in parallel and then fused together to track objects across the spatially separated cameras. The colour appearance cue is incrementally calibrated through transformation matrices, while probabilistic links, modelling an object's bounding box, between cameras represent the objects relative size. Probabilistic region links between entry and exit areas on cameras provide the cue of movement. The approach needs no pre colour or environment calibration and does not use batch processing. It works completely unsupervised, and is able to become more accurate over time as new evidence is accumulated.

[1]  Ramesh C. Jain,et al.  An architecture for multiple perspective interactive video , 1995, MULTIMEDIA '95.

[2]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Sergio A. Velastin,et al.  Intelligent distributed video surveillance systems , 2006 .

[4]  Fatih Murat Porikli,et al.  Inter-camera color calibration by correlation model function , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[5]  D. Makris Learning a Multi-camera Topology , 2003 .

[6]  Greg Welch,et al.  Ensuring color consistency across multiple cameras , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[7]  Richard Bowden,et al.  A Unifying Framework for Mutual Information Methods for Use in Non-linear Optimisation , 2006, ECCV.

[8]  Michael Felsberg,et al.  P-Channels: Robust Multivariate M-Estimation of Large Datasets , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[9]  Ramin Zabih,et al.  Bayesian multi-camera surveillance , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[10]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[11]  Richard Bowden,et al.  A real time adaptive visual surveillance system for tracking low-resolution colour targets in dynamically changing scenes , 2003, Image Vis. Comput..

[12]  R. Bowden,et al.  Towards automated wide area visual surveillance: tracking objects between spatially-separated, uncalibrated views , 2005 .

[13]  Greg Welch,et al.  Welch & Bishop , An Introduction to the Kalman Filter 2 1 The Discrete Kalman Filter In 1960 , 1994 .

[14]  Richard Bowden,et al.  Tracking objects across uncalibrated, arbitrary topology camera networks , 2006 .

[15]  Mubarak Shah,et al.  Tracking across multiple cameras with disjoint views , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[16]  T. Ellis,et al.  Wide area surveillance with a multi camera network , 2004 .

[17]  Shaogang Gong,et al.  Bayesian Modality Fusion for Tracking Multiple People with a Multi-Camera System , 2002 .

[18]  Julia Sturges,et al.  Locating basic colours in the munsell space , 1995 .

[19]  Michael J. Brooks,et al.  A Stochastic Approach to Tracking Objects Across Multiple Cameras , 2004, Australian Conference on Artificial Intelligence.

[20]  Jake K. Aggarwal,et al.  Tracking human motion using multiple cameras , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[21]  Andrew Gilbert,et al.  Tracking Objects Across Cameras by Incrementally Learning Inter-camera Colour Calibration and Patterns of Activity , 2006, ECCV.

[22]  Stuart J. Russell,et al.  Object Identification in a Bayesian Context , 1997, IJCAI.

[23]  James Orwell,et al.  On the Use of MPEG-7 for Visual Surveillance , 2006 .