Coverage management for mobile targets in visual sensor networks

Visual sensor networks (VSNs) are becoming increasingly popular in a number of application domains. A critical ability of such networks is to self-configure to minimize the need for operator control, improve scalability, and reduce cost. One of the areas of self-configuration is camera coverage control: how cameras adjust their field-of-view to allow automatic tracking of maximum number of targets. The problem is shown to be NP-hard for stationary targets, and efficient centralized, distributed and semi-centralized heuristics exist that perform close to optimal. For stationary targets camera configuration is a one-time activity and can happen offline and before the actual deployment. In contrast, if the targets are mobile, as the targets move away from their recorded positions, the cameras need to configure dynamically and in real-time to ensure coverage accuracy. In this paper, we propose several policies for automatic control of the cameras with a goal of coverage maximization for mobile targets. We study these policies using important performance metrics such as coverage gain, adaptability, scalability, and energy consumption. Our results indicate that factors such as target mobility models, target and camera scales/densities, and target velocities have significant impact on the performance of a given policy. For most of the scenarios, we found that the protocols that take into account non-local information (e.g. neighborhood information) and have self-adapting parameters (e.g. frequency of camera configurations) outperform the protocols that are either purely local or purely global and have non-adaptive parameters.

[1]  Dimitrios Lymberopoulos,et al.  Sensor Localization and Camera Calibration in Distributed Camera Sensor Networks , 2006, 2006 3rd International Conference on Broadband Communications, Networks and Systems.

[2]  Ian F. Akyildiz,et al.  A survey on wireless multimedia sensor networks , 2007, Comput. Networks.

[3]  Mary W. Green The appropriate and effective use of security technologies in U.S. schools : a guide for schools and law enforcement agencies. , 1999 .

[4]  Andrea Cavallaro,et al.  Multi-Camera Networks , 2009 .

[5]  Andrea Cavallaro,et al.  Multi-Camera Networks: Principles and Applications , 2009 .

[6]  Giordano Fusco,et al.  Selection and Orientation of Directional Sensors for Coverage Maximization , 2009, 2009 6th Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks.

[7]  Demetri Terzopoulos,et al.  Planning ahead for PTZ camera assignment and handoff , 2009, 2009 Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC).

[8]  A. El Gamal,et al.  Object Tracking in the Presence of Occlusions via a Camera Network , 2007, 2007 6th International Symposium on Information Processing in Sensor Networks.

[9]  Agusti Solanas,et al.  3D simultaneous localization and modeling from stereo vision , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[10]  Alhussein A. Abouzeid,et al.  Coverage by directional sensors in randomly deployed wireless sensor networks , 2006, J. Comb. Optim..

[11]  Minglu Li,et al.  Target-oriented scheduling in directional sensor networks , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[12]  Amit K. Roy-Chowdhury,et al.  Distributed multi-target tracking in a self-configuring camera network , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Xin Cui,et al.  Adaptive Increase and Adaptive Decrease Algorithm for Wireless TCP , 2007, Third International Conference on Natural Computation (ICNC 2007).

[14]  Jennifer C. Hou,et al.  Tracking targets with quality in wireless sensor networks , 2005, 13TH IEEE International Conference on Network Protocols (ICNP'05).

[15]  Gaurav S. Sukhatme,et al.  Reconfiguration methods for mobile sensor networks , 2007, TOSN.

[16]  Yu-Chee Tseng,et al.  The Coverage Problem in a Wireless Sensor Network , 2003, WSNA '03.

[17]  A. Hampapur,et al.  Smart video surveillance: exploring the concept of multiscale spatiotemporal tracking , 2005, IEEE Signal Processing Magazine.

[18]  R. Lienhart,et al.  On the optimal placement of multiple visual sensors , 2006, VSSN '06.

[19]  Anlong Ming,et al.  A Coverage-Enhancing Method for 3D Directional Sensor Networks , 2009, IEEE INFOCOM 2009.

[20]  Stan Sclaroff,et al.  Automated camera layout to satisfy task-specific and floor plan-specific coverage requirements , 2006, Comput. Vis. Image Underst..

[21]  Jesús Martínez Navarro Evaluation of the impact of mobility models on handover in WLAN indoor environments , 2009 .

[22]  Chieh-Chih Wang,et al.  LADAR-based detection and tracking of moving objects from a ground vehicle at high speeds , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[23]  B. S. Manjunath,et al.  Spatial-temporal understanding of urban scenes through large camera network , 2010, MPVA '10.

[24]  Jörg Hähner,et al.  Spatial Partitioning in Self-Organizing Smart Camera Systems , 2008, IEEE Journal of Selected Topics in Signal Processing.

[25]  David A. Maltz,et al.  A performance comparison of multi-hop wireless ad hoc network routing protocols , 1998, MobiCom '98.

[26]  Kenro Miyamoto,et al.  Fish Eye Lens , 1964 .

[27]  Guoliang Xing,et al.  Integrated coverage and connectivity configuration in wireless sensor networks , 2003, SenSys '03.

[28]  Mohan S. Kankanhalli,et al.  Decision-theoretic approach to maximizing observation of multiple targets in multi-camera surveillance , 2012, AAMAS.

[29]  Prashant J. Shenoy,et al.  SensEye: a multi-tier camera sensor network , 2005, ACM Multimedia.

[30]  Takashi Matsuyama,et al.  Versatile Cooperative Multiple-Object Tracking by Active Vision Agents , 2000, MVA.

[31]  Ting Yu,et al.  Collaborative Real-Time Control of Active Cameras in Large Scale Surveillance Systems , 2008 .

[32]  Tomaso A. Poggio,et al.  A general framework for object detection , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[33]  Jorge Urrutia,et al.  Art Gallery and Illumination Problems , 2000, Handbook of Computational Geometry.

[34]  Nael B. Abu-Ghazaleh,et al.  Scalable target coverage in smart camera networks , 2010, ICDSC '10.