Distant targets identification as an on-line dynamic vehicle routing problem using an active-zooming camera

This paper considers the problem of modeling an active observer to plan a sequence of decisions regarding what target to look at, through a foveal-sensing action. The gathered images by the active observer provides meaningful identification imagery of distant targets which are not recognizable in a wide angle view. We propose a framework in which a pan/tilt/zoom (PTZ) camera schedules saccades in order to acquire high resolution images of as many moving targets as possible before they leave the scene. We cast the whole problem as a particular kind of dynamic discrete optimization, specially as a novel on-line dynamic vehicle routing problem (DVRP) with deadlines. We show that using an optimal choice for the sensing order of targets the total time spent in visiting the targets by the active camera can be significantly reduced. To show the effectiveness of our approach we apply congestion analysis to a dual camera system in a master-slave configuration. We report that our framework gives good results in monitoring wide areas with little extra costs with respect to approaches using a large number of cameras.

[1]  Andrzej Lingas,et al.  Approximation algorithms for time-dependent orienteering , 2001, Inf. Process. Lett..

[2]  Heinrich Niemann,et al.  Statistical modeling and performance characterization of a real-time dual camera surveillance system , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[3]  Takeo Kanade,et al.  Algorithms for cooperative multisensor surveillance , 2001, Proc. IEEE.

[4]  Sharath Pankanti,et al.  Face cataloger: multi-scale imaging for relating identity to location , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[5]  Larry S. Davis,et al.  Scalable image-based multi-camera visual surveillance system , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[6]  Ian D. Reid,et al.  Driving saccade to pursuit using image motion , 1995, International Journal of Computer Vision.

[7]  J. Batista,et al.  Real-time active visual surveillance by integrating peripheral motion detection with foveated tracking , 1998, Proceedings 1998 IEEE Workshop on Visual Surveillance.

[8]  T. Kanade,et al.  A master-slave system to acquire biometric imagery of humans at distance , 2003, IWVS '03.

[9]  Alex Zelikovsky,et al.  The moving-target traveling salesman problem , 2003, J. Algorithms.

[10]  Alberto Del Bimbo,et al.  Metric 3D reconstruction and texture acquisition of surfaces of revolution from a single uncalibrated view , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Dimitris Bertsimas,et al.  A Stochastic and Dynamic Vehicle Routing Problem in the Euclidean Plane , 1991, Oper. Res..

[12]  C. Diehl,et al.  Scheduling an active camera to observe people , 2004, VSSN '04.

[13]  R. Hartley,et al.  Linear calibration of a rotating and zooming camera ∗ , 1999 .

[14]  Andrzej Lingas,et al.  Approximation algorithms for time-dependent orienteering , 2002, Inf. Process. Lett..

[15]  Rajeev Motwani,et al.  Algorithms for Robot Grasp and Delivery , 1996 .

[16]  Marc Pollefeys,et al.  Towards calibrating a pan-tilt-zoom camera network , 2004 .

[17]  Ben Tordoff,et al.  Active control of zoom for computer vision , 2002 .

[18]  Carlo S. Regazzoni,et al.  Dual camera system for face detection in unconstrained environments , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[19]  Irfan Essa,et al.  A System for Tracking and Recognizing Multiple People with Multiple Cameras , 1998 .

[20]  James H. Elder,et al.  Pre-Attentive Face Detection for Foveated Wide-Field Surveillance , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[21]  Max Lu,et al.  Acquiring Multi-Scale Images by Pan-Tilt-Zoom Control and Automatic Multi-Camera Calibration , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.