An Overview of Distributed Tracking and Control in Camera Networks

In many applications, the information from all the cameras are transmitted to a centralized processing unit. However, for larger networks, centralized schemes can be unscalable and they also exhibit the risk of having a single point of failure. These are some of the many reasons why distributed schemes are being chosen over centralized schemes in various applications nowadays. This chapter provides a comprehensive overview of state-of-the-art distributed tracking and control strategies using a camera network and identifies the main directions of future work.

[1]  Jason R. Marden,et al.  Autonomous Vehicle-Target Assignment: A Game-Theoretical Formulation , 2007 .

[2]  Trevor Darrell,et al.  Simultaneous calibration and tracking with a network of non-overlapping sensors , 2004, CVPR 2004.

[3]  Mubarak Shah,et al.  A Multiview Approach to Tracking People in Crowded Scenes Using a Planar Homography Constraint , 2006, ECCV.

[4]  Kagan Tumer,et al.  A Survey of Collectives , 2004 .

[5]  Amit K. Roy-Chowdhury,et al.  Tracking and Activity Recognition Through Consensus in Distributed Camera Networks , 2010, IEEE Transactions on Image Processing.

[6]  Jason R. Marden,et al.  Cooperative Control and Potential Games , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[7]  Max Donath,et al.  American Control Conference , 1993 .

[8]  Luc Moreau,et al.  Stability of multiagent systems with time-dependent communication links , 2005, IEEE Transactions on Automatic Control.

[9]  Bir Bhanu,et al.  Utility-based dynamic camera assignment and hand-off in a video network , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[10]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[11]  Amit K. Roy-Chowdhury,et al.  Collaborative Sensing in a Distributed PTZ Camera Network , 2012, IEEE Transactions on Image Processing.

[12]  Derek Kingston,et al.  Decentralized Control of Multiple UAVs for Perimeter and Target Surveillance , 2007 .

[13]  Bernhard Rinner,et al.  Video Analysis in Pan-Tilt-Zoom Camera Networks , 2010, IEEE Signal Processing Magazine.

[14]  David R. Bull,et al.  Projective image restoration using sparsity regularization , 2013, 2013 IEEE International Conference on Image Processing.

[15]  Jonathan P. How,et al.  An unbiased Kalman consensus algorithm , 2006 .

[16]  Amit K. Roy-Chowdhury,et al.  Coordinated sensing and tracking for mobile camera platforms , 2012, 2012 American Control Conference (ACC).

[17]  Rama Chellappa,et al.  Object Detection, Tracking and Recognition for Multiple Smart Cameras , 2008, Proceedings of the IEEE.

[18]  Jian Zhao,et al.  Optimal Camera Network Configurations for Visual Tagging , 2008, IEEE Journal of Selected Topics in Signal Processing.

[19]  Reza Olfati-Saber,et al.  Kalman-Consensus Filter : Optimality, stability, and performance , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[20]  Yin Chen,et al.  Corrective consensus: Converging to the exact average , 2010, 49th IEEE Conference on Decision and Control (CDC).

[21]  Murat Kunt,et al.  A master-slave approach for object detection and matching with fixed and mobile cameras , 2008, 2008 15th IEEE International Conference on Image Processing.

[22]  Mubarak Shah,et al.  Camera handoff: tracking in multiple uncalibrated stationary cameras , 2000, Proceedings Workshop on Human Motion.

[23]  Venkatesh Saligrama,et al.  Abnormal behavior detection and behavior matching for networked cameras , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[24]  Mubarak Shah,et al.  Human tracking in multiple cameras , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[25]  H. Peyton Young,et al.  Individual Strategy and Social Structure , 2020 .

[26]  Amit K. Roy-Chowdhury,et al.  Information weighted consensus , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[27]  Luigi Chisci,et al.  Optimal UAV coordination for target tracking using dynamic programming , 2010, 49th IEEE Conference on Decision and Control (CDC).

[28]  Amit K. Roy-Chowdhury,et al.  Stochastic Adaptive Tracking In A Camera Network , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[29]  R. Olfati-Saber,et al.  Distributed tracking in sensor networks with limited sensing range , 2008, 2008 American Control Conference.

[30]  Kagan Tumer,et al.  Collectives and Design Complex Systems , 2004 .

[31]  Andrea Cavallaro,et al.  Distributed and Decentralized Multicamera Tracking , 2011, IEEE Signal Processing Magazine.

[32]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[33]  René Vidal,et al.  Distributed Computer Vision Algorithms , 2011, IEEE Signal Processing Magazine.

[34]  M. Pachter,et al.  Optimum cooperative UAV sensing based on Cramer-Rao bound , 2005, Proceedings of the 2005, American Control Conference, 2005..

[35]  Demetri Terzopoulos,et al.  Surveillance in Virtual Reality: System Design and Multi-Camera Control , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  W. Eric L. Grimson,et al.  Inference of non-overlapping camera network topology by measuring statistical dependence , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[37]  C. Micheloni,et al.  A network of co-operative cameras for visual surveillance , 2005 .

[38]  Stan Sclaroff,et al.  Automated camera layout to satisfy task-specific and floor plan-specific coverage requirements , 2006, Comput. Vis. Image Underst..

[39]  Amit K. Roy-Chowdhury,et al.  Distributed Camera Networks , 2011, IEEE Signal Processing Magazine.

[40]  Tsuhan Chen,et al.  Active Multicamera Networks: From Rendering to Surveillance , 2008, IEEE Journal of Selected Topics in Signal Processing.

[41]  Zhaolin Cheng,et al.  Calibrating Distributed Camera Networks , 2008, Proceedings of the IEEE.

[42]  Amit K. Roy-Chowdhury,et al.  A Generalized Kalman Consensus Filter for wide-area video networks , 2011, IEEE Conference on Decision and Control and European Control Conference.

[43]  R.W. Beard,et al.  Multi-agent Kalman consensus with relative uncertainty , 2005, Proceedings of the 2005, American Control Conference, 2005..

[44]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[45]  Amit K. Roy-Chowdhury,et al.  Distributed multi-target tracking in a self-configuring camera network , 2009, CVPR.

[46]  Justus H. Piater,et al.  Multi-camera People Tracking by Collaborative Particle Filters and Principal Axis-Based Integration , 2007, ACCV.

[47]  Amit K. Roy-Chowdhury,et al.  Belief consensus for distributed action recognition , 2011, 2011 18th IEEE International Conference on Image Processing.

[48]  Amit K. Roy-Chowdhury,et al.  Decentralized camera network control using game theory , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[49]  René Vidal,et al.  Distributed computer vision algorithms through distributed averaging , 2011, CVPR 2011.

[50]  Bir Bhanu,et al.  Distributed Video Sensor Networks , 2011 .

[51]  C. Ding,et al.  Optimized imaging and target tracking within a distributed camera network , 2011, Proceedings of the 2011 American Control Conference.

[52]  Alan Yuille,et al.  Active Vision , 2014, Computer Vision, A Reference Guide.

[53]  Chen Wu,et al.  Real-Time Human Pose Estimation: A Case Study in Algorithm Design for Smart Camera Networks , 2008, Proceedings of the IEEE.

[54]  L. Shapley,et al.  REGULAR ARTICLEPotential Games , 1996 .