A stochastic reachability framework for autonomous surveillance with pan-tilt-zoom cameras

In this work a framework for camera-based autonomous surveillance is introduced based on the theory of stochastic reachability and random sets. We consider set-valued models of a single pan-tilt-zoom (PTZ) camera (pursuer) and multiple targets that need to be tracked (evaders). We define the stochastic pursuer process and the stochastic evader processes and consider the problem of maximizing the probability of satisfying safety (tracking), reachability (acquisition), and reach-avoid (tracking while acquiring) objectives. The solution of the safety, reachability, and reach-avoid tasks are computed via dynamic programming resulting in an optimal control policy for the PTZ camera. Experimental results are given for a single PTZ camera and multiple robotic evaders.

[1]  Sergio A. Velastin,et al.  Intelligent distributed surveillance systems: a review , 2005 .

[2]  G. Fiengo,et al.  Optimal camera trajectory for video surveillance systems , 2006, 2006 American Control Conference.

[3]  Gregory F. Welch,et al.  On-line control of active camera networks , 2010 .

[4]  Ehud Rivlin,et al.  Scanning and tracking with independent cameras—a biologically motivated approach based on model predictive control , 2008, Auton. Robots.

[5]  Amit K. Roy-Chowdhury,et al.  Decentralized camera network control using game theory , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[6]  I. Molchanov.  Theory of Random Sets , 2005 .

[7]  G. Matheron.  Random Sets and Integral Geometry , 1976 .

[8]  John Lygeros,et al.  Computational Approaches to Reachability Analysis of Stochastic Hybrid Systems , 2007, HSCC.

[9]  Dimitri P. Bertsekas,et al.  Stochastic optimal control : the discrete time case , 2007 .

[10]  John Lygeros,et al.  A Probabilistic Reach-Avoid Problem for Controlled Discrete Time Stochastic Hybrid Systems , 2009, ADHS.

[11]  John Lygeros,et al.  Verification of discrete time stochastic hybrid systems: A stochastic reach-avoid decision problem , 2010, Autom..

[12]  Nicu Sebe,et al.  Cooperative Object Tracking with Multiple PTZ Cameras , 2007, 14th International Conference on Image Analysis and Processing (ICIAP 2007).

[13]  J.P. Hespanha,et al.  Multiple-agent probabilistic pursuit-evasion games , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[14]  Luca Schenato,et al.  Distributed perimeter patrolling and tracking for camera networks , 2010, 49th IEEE Conference on Decision and Control (CDC).

[15]  Manfred Morari,et al.  A tracking algorithm for PTZ cameras , 2010 .

[16]  John Lygeros,et al.  Probabilistic reachability and safety for controlled discrete time stochastic hybrid systems , 2008, Autom..

[17]  S. Sastry,et al.  Probabilistic pursuit-evasion games: a one-step Nash approach , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[18]  John Lygeros,et al.  A stochastic reach-avoid problem with random obstacles , 2011, HSCC '11.

[19]  Ting Yu,et al.  Collaborative Real-Time Control of Active Cameras in Large Scale Surveillance Systems , 2008 .

[20]  S. Shankar Sastry,et al.  Probabilistic pursuit-evasion games: theory, implementation, and experimental evaluation , 2002, IEEE Trans. Robotics Autom..

[21]  Luc Van Gool,et al.  A distributed camera system for multi-resolution surveillance , 2009, 2009 Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC).