Can You See Me Now? Sensor Positioning for Automated and Persistent Surveillance

Most existing camera placement algorithms focus on coverage and/or visibility analysis, which ensures that the object of interest is visible in the camera's field of view (FOV). However, visibility, which is a fundamental requirement of object tracking, is insufficient for automated persistent surveillance. In such applications, a continuous consistently labeled trajectory of the same object should be maintained across different camera views. Therefore, a sufficient uniform overlap between the cameras' FOVs should be secured so that camera handoff can successfully and automatically be executed before the object of interest becomes untraceable or unidentifiable. In this paper, we propose sensor-planning methods that improve existing algorithms by adding handoff rate analysis. Observation measures are designed for various types of cameras so that the proposed sensor-planning algorithm is general and applicable to scenarios with different types of cameras. The proposed sensor-planning algorithm preserves necessary uniform overlapped FOVs between adjacent cameras for an optimal balance between coverage and handoff success rate. In addition, special considerations such as resolution and frontal-view requirements are addressed using two approaches: 1) direct constraint and 2) adaptive weights. The resulting camera placement is compared with a reference algorithm published by Erdem and Sclaroff. Significantly improved handoff success rates and frontal-view percentages are illustrated via experiments using indoor and outdoor floor plans of various scales.

[1]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Larry S. Davis,et al.  COST: An Approach for Camera Selection and Multi-Object Inference Ordering in Dynamic Scenes , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[3]  Sanjeev Khanna,et al.  Target tracking with distributed sensors: the focus of attention problem , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[4]  Pierre David,et al.  A Sensor Placement Approach for the Monitoring of Indoor Scenes , 2007, EuroSSC.

[5]  R. Lienhart,et al.  On the optimal placement of multiple visual sensors , 2006, VSSN '06.

[6]  Sajal K. Das,et al.  Promoting Heterogeneity, Mobility, and Energy-Aware Voronoi Diagram in Wireless Sensor Networks , 2008, IEEE Transactions on Parallel and Distributed Systems.

[7]  Yuanyuan Yang,et al.  Adaptive Triangular Deployment Algorithm for Unattended Mobile Sensor Networks , 2005, IEEE Transactions on Computers.

[8]  Masatsugu Kidode,et al.  Multiple Active Camera Assignment for High Fidelity 3D Video , 2006, Fourth IEEE International Conference on Computer Vision Systems (ICVS'06).

[9]  Lovell Hodge,et al.  A Simulation Environment for Multi-Sensor Planning , 2001, Simul..

[10]  Mongi A. Abidi,et al.  Sensor planning for automated and persistent object tracking with multiple cameras , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Xing Chen,et al.  An occlusion metric for selecting robust camera configurations , 2008, Machine Vision and Applications.

[12]  P. Chiu,et al.  A simulated annealing algorithm to support the sensor placement for target location , 2004, Canadian Conference on Electrical and Computer Engineering 2004 (IEEE Cat. No.04CH37513).

[13]  Thierry Siméon,et al.  Planning human walk in virtual environments , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Stan Sclaroff,et al.  Automated camera layout to satisfy task-specific and floor plan-specific coverage requirements , 2006, Comput. Vis. Image Underst..

[15]  Christophe Dumont,et al.  Next best view system in a 3D object modeling task , 1999, Proceedings 1999 IEEE International Symposium on Computational Intelligence in Robotics and Automation. CIRA'99 (Cat. No.99EX375).

[16]  D. Terzopoulos,et al.  Towards intelligent camera networks: a virtual vision approach , 2005, 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance.

[17]  Pascal Frossard,et al.  Omnidirectional Views Selection for Scene Representation , 2006, 2006 International Conference on Image Processing.

[18]  Jie Wu,et al.  Scan-Based Movement-Assisted Sensor Deployment Methods in Wireless Sensor Networks , 2007, IEEE Transactions on Parallel and Distributed Systems.

[19]  Juho Kannala,et al.  A generic camera calibration method for fish-eye lenses , 2004, ICPR 2004.

[20]  Michel Bierlaire,et al.  Behavioral Priors for Detection and Tracking of Pedestrians in Video Sequences , 2006, International Journal of Computer Vision.

[21]  Krishnendu Chakrabarty,et al.  Sensor deployment and target localization in distributed sensor networks , 2004, TECS.

[22]  Mongi A. Abidi,et al.  Survey and analysis of multimodal sensor planning and integration for wide area surveillance , 2009, CSUR.

[23]  Yifan Chen,et al.  CAD-guided sensor planning for dimensional inspection in automotive manufacturing , 2003 .

[24]  V. K. Singh,et al.  A design methodology for selection and placement of sensors in multimedia surveillance systems , 2006, VSSN '06.

[25]  J. O'Rourke.  Art gallery theorems and algorithms , 1987 .

[26]  Subhashis Banerjee,et al.  Recognizing large isolated 3-D objects through next view planning using inner camera invariants , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[27]  Nikolaos Papanikolopoulos,et al.  Multi-Camera Human Activity Monitoring , 2008, J. Intell. Robotic Syst..

[28]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[29]  Andreas Krause,et al.  Near-Optimal Sensor Placements in Gaussian Processes: Theory, Efficient Algorithms and Empirical Studies , 2008, J. Mach. Learn. Res..

[30]  James W. Davis,et al.  An adaptive focus-of-attention model for video surveillance and monitoring , 2007, Machine Vision and Applications.

[31]  Larry S. Davis,et al.  Visibility Analysis and Sensor Planning in Dynamic Environments , 2004, ECCV.

[32]  Shengyong Chen,et al.  Active Sensor Planning for Multiview Vision Tasks , 2008 .

[33]  M. Saadatseresht,et al.  Automatic Camera Placement in Vision Metrology Based On A Fuzzy Inference System , 2005 .

[34]  Mubarak Shah,et al.  Consistent Labeling of Tracked Objects in Multiple Cameras with Overlapping Fields of View , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Sampath Kannan,et al.  VC-dimension of exterior visibility , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Jay Lee.  Analyses of visibility sites on topographic surfaces , 1991, Int. J. Geogr. Inf. Sci..

[37]  Nikolaos Papanikolopoulos,et al.  Multi-camera positioning to optimize task observability , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[38]  MengChu Zhou,et al.  Adaptive Sensor Placement and Boundary Estimation for Monitoring Mass Objects , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[39]  Krishnendu Chakrabarty,et al.  Sensor deployment and target localization based on virtual forces , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[40]  Enrique Dunn,et al.  Parisian camera placement for vision metrology , 2006, Pattern Recognit. Lett..

[41]  Y.F. Li,et al.  Automatic sensor placement for model-based robot vision , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[42]  Subhashis Banerjee,et al.  Active recognition through next view planning: a survey , 2004, Pattern Recognit..

[43]  Zhongmin Wang,et al.  Automatic dynamic flocking in mobile actuator sensor networks by central Voronoi tessellations , 2005, IEEE International Conference Mechatronics and Automation, 2005.

[44]  Xiang Gao,et al.  Omni-directional visual surveillance , 2004, Image Vis. Comput..

[45]  Jake K. Aggarwal,et al.  Tracking Human Motion in Structured Environments Using a Distributed-Camera System , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  Konstantinos A. Tarabanis,et al.  A survey of sensor planning in computer vision , 1995, IEEE Trans. Robotics Autom..

[47]  Livier Reithler,et al.  Optimal deployment of cameras for video surveillance systems , 2007, 2007 IEEE Conference on Advanced Video and Signal Based Surveillance.

[48]  Subhashis Banerjee,et al.  Isolated 3D object recognition through next view planning , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[49]  C. Guestrin,et al.  Near-optimal sensor placements: maximizing information while minimizing communication cost , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[50]  Yeh-Ching Chung,et al.  A Delaunay Triangulation based method for wireless sensor network deployment , 2007, Comput. Commun..

[51]  Thomas F. La Porta,et al.  Movement-assisted sensor deployment , 2004, IEEE INFOCOM 2004.

[52]  Xianghua Ying,et al.  Can We Consider Central Catadioptric Cameras and Fisheye Cameras within a Unified Imaging Model , 2004, ECCV.