Active-Vision for the Autonomous Surveillance of Dynamic, Multi-Object Environments

This paper presents a novel method for active-vision-based sensing-system reconfiguration for the autonomous surveillance of an object-of-interest as it travels through a multi-object dynamic workspace with an a priori unknown trajectory. Several approaches have been previously proposed to address the problem of sensor selection and control. However, these have primarily relied on off-line planning methods and rarely utilized on-line planning to compensate for unexpected variations in a target’s trajectory. The method proposed in this paper, on the other hand, uses a multi-agent system for on-line sensing-system reconfiguration, eliminating the need for any a priori knowledge of the target’s trajectory. Thus, it is robust to unexpected variations in the environment. Simulations and experiments have shown that the use of dynamic sensors with the proposed on-line reconfiguration algorithm can tangibly improve the performance of an active-surveillance system.

[1]  Michael G. Kay,et al.  Multimedia sensor fusion for intelligent camera control , 1996, 1996 IEEE/SICE/RSJ International Conference on Multisensor Fusion and Integration for Intelligent Systems (Cat. No.96TH8242).

[2]  Mohamed S. Kamel,et al.  A coordination mechanism for model-based multi-sensor planning , 2002, Proceedings of the IEEE Internatinal Symposium on Intelligent Control.

[3]  Roger Y. Tsai,et al.  Analytical characterization of the feature detectability constraints of resolution, focus, and field-of-view for vision sensor planning , 1994 .

[4]  Bryan Horling,et al.  Distributed Sensor Network for Real Time Tracking TITLE2 , 2000 .

[5]  Avinash C. Kak,et al.  Spar: A Planner that Satisfies Operational and Geometric Goals in Uncertain Environments , 1990, AI Mag..

[6]  Beno Benhabib,et al.  A multi-sensor surveillance system for active-vision based object localization , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[7]  Yiming Ye,et al.  Sensor Planning for 3D Object Search, , 1999, Comput. Vis. Image Underst..

[8]  Ruzena Bajcsy,et al.  The Sensor Selection Problem for Bounded Uncertainty Sensing Models , 2005, IEEE Transactions on Automation Science and Engineering.

[9]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[10]  Konstantinos A. Tarabanis,et al.  A survey of sensor planning in computer vision , 1995, IEEE Trans. Robotics Autom..

[11]  Takashi Matsuyama,et al.  Active Image Capturing and Dynamic Scene Visualization by Cooperative Distributed Vision , 1998, AMCP.

[12]  Yifan Chen,et al.  CAD-guided sensor planning for dimensional inspection in automotive manufacturing , 2003 .

[13]  R. Vincent,et al.  SPT : Distributed Sensor Network for Real Time Tracking , 2000 .

[14]  Hong Zhang.  Two-dimensional optimal sensor placement , 1995, IEEE Trans. Syst. Man Cybern..

[15]  Ümit Özgüner,et al.  Motion planning for multitarget surveillance with mobile sensor agents , 2005, IEEE Transactions on Robotics.

[16]  Y.F. Li,et al.  Automatic sensor placement for model-based robot vision , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  Diane J. Cook.  Reconfiguration of Multi-agent Planning Systems , 1994, AIPS.

[18]  Peter Kovesi,et al.  Automatic Sensor Placement from Vision Task Requirements , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[20]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[21]  Gregory D. Hager,et al.  Dynamic sensor planning in visual servoing , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[22]  Shigeyuki Sakane,et al.  Sensor planning for mobile robot localization using Bayesian network inference , 2002, Adv. Robotics.

[23]  Roger Y. Tsai,et al.  Model-Based Planning of Sensor Placement and Optical Settings , 1990, Other Conferences.

[24]  Camillo J. Taylor,et al.  Dynamic Sensor Planning and Control for Optimally Tracking Targets , 2003, Int. J. Robotics Res..

[25]  Roger Y. Tsai,et al.  Occlusion-Free Sensor Placement Planning , 1990 .

[26]  Beno Benhabib,et al.  Three-dimensional location estimation of circular features for machine vision , 1992, IEEE Trans. Robotics Autom..

[27]  Glenn H. Tarbox,et al.  Planning for Complete Sensor Coverage in Inspection , 1995, Comput. Vis. Image Underst..

[28]  S. Iyengar,et al.  Multi-Sensor Fusion: Fundamentals and Applications With Software , 1997 .

[29]  Lawrence B. Holder,et al.  Decision-Theoretic Cooperative Sensor Planning , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Andrew M. Wallace,et al.  Model-based planning of optimal sensor placements for inspection , 1997, IEEE Trans. Robotics Autom..

[31]  Gregory Dudek,et al.  Simultaneous planning, localization, and mapping in a camera sensor network , 2006, Robotics Auton. Syst..

[32]  David P. Anderson.  Efficient algorithms for automatic viewer orientation , 1985, Comput. Graph..

[33]  Victor R. Lesser,et al.  Distributed sensor network for real time tracking , 2001, AGENTS '01.

[34]  Beno Benhabib,et al.  Coordinated dispatching of proximity sensors for the surveillance of manoeuvring targets , 2003 .

[35]  Aly A. Farag,et al.  Image content-based active sensor planning for a mobile trinocular active vision system , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[36]  Henrik I. Christensen,et al.  Bayesian methods for interpretation and control in multiagent vision systems , 1992, Defense, Security, and Sensing.

[37]  Keith Marzullo,et al.  Tolerating failures of continuous-valued sensors , 1990, TOCS.

[38]  Norimichi Ukita,et al.  Real-time cooperative multi-target tracking by communicating active vision agents , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.