Realtime face detection and tracking using a single Pan, Tilt, Zoom camera

Surveillance cameras generally have a wide field of view and do not capture the human face with a resolution that is sufficient for machine recognition. To overcome this problem, this paper presents a realtime face detection and tracking algorithm using a single PTZ (Pan, Tilt, Zoom) camera. Unlike existing algorithms which track the human face in the field of view of a fixed camera, the proposed algorithm adjusts the pan, tilt and zoom of a PTZ camera in real-time so that human faces can be acquired at the camerapsilas maximum resolution. The proposed algorithm addresses challenges like network delays, camera movement lags, oscillations and lost faces. Experiments were performed in realistic surveillance scenarios and accurate real-time tracking with pan, tilt and zoom was achieved.

[1]  Hiroyasu Koshimizu,et al.  Hierarchical face tracking by using PTZ camera , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[2]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[3]  Gary Bradski,et al.  Computer Vision Face Tracking For Use in a Perceptual User Interface , 1998 .

[4]  Max Lu,et al.  Acquiring Multi-Scale Images by Pan-Tilt-Zoom Control and Automatic Multi-Camera Calibration , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[5]  Supavadee Aramvith,et al.  Face Tracking Using Two Cooporative Static and Moving Cameras , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[6]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[7]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[8]  Yiming Ye,et al.  Tracking a Person with Pre-recorded Image Database and a Pan, Tilt, and Zoom Camera , 1998, ACCV.

[9]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[10]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[11]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[12]  Philippe Martinet,et al.  Object tracking with a pan-tilt-zoom camera: application to car driving assistance , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[13]  Norbert Krüger,et al.  Face Recognition by Elastic Bunch Graph Matching , 1997, CAIP.

[14]  Arun Ross,et al.  An introduction to biometric recognition , 2004, IEEE Transactions on Circuits and Systems for Video Technology.