Surprisal-aware scheduling of PTZ cameras

An approach is presented for scheduling PTZ cameras on guard tours with two or more fields of view. In contrast to the target tracking of previous work, this approach seeks to optimise the coverage of the area under surveillance. Specifically, the aim is to minimise the surprisal (self-information) of events in unobserved fields of view. An entropy driven scheduler based on Kullback-Leibler divergence (information gain) is presented, and compared with three naive schedulers (random, round robin and constant selection of one field of view). Experiments investigate its performance on networks of ten cameras. These are evaluated over factors including four different scheduling approaches, different numbers of fields of view, and different inactive times whilst switching views. They demonstrate the efficacy of the entropy driven scheduler as it outperforms the naive schedulers by a significant margin by favouring certain fields of view that are more likely to reveal events with high surprisal value. The scheduler is target agnostic, as it operates on low level properties of the video signal, specifically, occupancy as determined by background subtraction. This permits an efficient implementation that is independent of the number of targets in the area under surveillance. As each camera is scheduled independently, the approach is scalable via distributed implementation, including on smart cameras.

[1]  Pierre Baldi,et al.  A principled approach to detecting surprising events in video , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[2]  Eric Sommerlade,et al.  Information-theoretic active scene exploration , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  S. Payandeh,et al.  Cooperative hybrid multi-camera tracking for people surveillance , 2008, Canadian Journal of Electrical and Computer Engineering.

[4]  Joachim Denzler,et al.  Information theoretic focal length selection for real-time active 3D object tracking , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[5]  Anton van den Hengel,et al.  Activity Topology Estimation for Large Networks of Cameras , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[6]  Eric Sommerlade,et al.  Cooperative surveillance of multiple targets using mutual information , 2008 .

[7]  Myron Tribus,et al.  Thermostatics and thermodynamics : an introduction to energy, information and states of matter, with engineering applications , 1961 .

[8]  A. Hampapur,et al.  Smart video surveillance: exploring the concept of multiscale spatiotemporal tracking , 2005, IEEE Signal Processing Magazine.

[9]  Nicu Sebe,et al.  Cooperative Object Tracking with Multiple PTZ Cameras , 2007, 14th International Conference on Image Analysis and Processing (ICIAP 2007).

[10]  Andrew D. Bagdanov,et al.  Acquisition of high-resolution images through on-line saccade sequence planning , 2005 .

[11]  Demetri Terzopoulos,et al.  Surveillance in Virtual Reality: System Design and Multi-Camera Control , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.