Reactive Object Tracking with a Single PTZ Camera

In this paper we describe a novel approach to reactive tracking of moving targets with a pan-tilt-zoom camera. The approach uses an extended Kalman filter to jointly track the object position in the real world, its velocity in 3D and the camera intrinsics, in addition to the rate of change of these parameters. The filter outputs are used as inputs to PID controllers which continuously adjust the camera motion in order to reactively track the object at a constant image velocity while simultaneously maintaining a desirable target scale in the image plane. We provide experimental results on simulated and real tracking sequences to show how our tracker is able to accurately estimate both 3D object position and camera intrinsics with very high precision over a wide range of focal lengths.

[1]  Juan C. Cockburn,et al.  Dual Camera Zoom Control: A Study of Zoom Tracking Stability , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[2]  Joachim Denzler,et al.  Information theoretic focal length selection for real-time active 3D object tracking , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[3]  J. L. Roux.  An Introduction to the Kalman Filter , 2003 .

[4]  F. Xavier Roca,et al.  Robust and Efficient Multipose Face Detection Using Skin Color Segmentation , 2009, IbPRIA.

[5]  Eric Sommerlade,et al.  Information-theoretic active scene exploration , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Yiannis Aloimonos,et al.  Active vision , 2004, International Journal of Computer Vision.

[7]  David W. Murray,et al.  A method of reactive zoom control from uncertainty in tracking , 2007, Comput. Vis. Image Underst..

[8]  Alberto Del Bimbo,et al.  Improving evidential quality of surveillance imagery through active face tracking , 2006, 18th International Conference on Pattern Recognition (ICPR'06).