Distributed multi-target tracking in a self-configuring camera network

This paper deals with the problem of tracking multiple targets in a distributed network of self-configuring pan-tilt-zoom cameras. We focus on applications where events unfold over a large geographic area and need to be analyzed by multiple overlapping and non-overlapping active cameras without a central unit accumulating and analyzing all the data. The overall goal is to keep track of all targets in the region of deployment of the cameras, while selectively focusing at a high resolution on some particular target features. To acquire all the targets at the desired resolutions while keeping the entire scene in view, we use cooperative network control ideas based on multi-player learning in games. For tracking the targets as they move through the area covered by the cameras, we propose a special application of the distributed estimation algorithm known as Kalman-Consensus filter through which each camera comes to a consensus with its neighboring cameras about the actual state of the target. This leads to a camera network topology that changes with time. Combining these ideas with single-view analysis, we have a completely distributed approach for multi-target tracking and camera network self-configuration. We show performance analysis results with real-life experiments on a network of 10 cameras.

[1]  Andreas Terzis,et al.  Distributed pose averaging in camera networks via consensus on SE(3) , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[2]  Bir Bhanu,et al.  Utility-based dynamic camera assignment and hand-off in a video network , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[3]  Jason R. Marden,et al.  Autonomous Vehicle-Target Assignment: A Game-Theoretical Formulation , 2007 .

[4]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[5]  Demetri Terzopoulos,et al.  Surveillance in Virtual Reality: System Design and Multi-Camera Control , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Justus H. Piater,et al.  Multi-camera People Tracking by Collaborative Particle Filters and Principal Axis-Based Integration , 2007, ACCV.

[7]  L. Shapley,et al.  Potential Games , 1994 .

[8]  W. Eric L. Grimson,et al.  Inference of non-overlapping camera network topology by measuring statistical dependence , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[9]  Mubarak Shah,et al.  A Multiview Approach to Tracking People in Crowded Scenes Using a Planar Homography Constraint , 2006, ECCV.

[10]  Henry Medeiros,et al.  Distributed Object Tracking Using a Cluster-Based Kalman Filter in Wireless Camera Networks , 2008, IEEE Journal of Selected Topics in Signal Processing.

[11]  Mubarak Shah,et al.  Camera handoff: tracking in multiple uncalibrated stationary cameras , 2000, Proceedings Workshop on Human Motion.

[12]  R. Olfati-Saber,et al.  Distributed tracking in sensor networks with limited sensing range , 2008, 2008 American Control Conference.

[13]  Amit K. Roy-Chowdhury,et al.  Decentralized camera network control using game theory , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[14]  Amit K. Roy-Chowdhury,et al.  Stochastic Adaptive Tracking In A Camera Network , 2007, 2007 IEEE 11th International Conference on Computer Vision.