Acquiring high-resolution face images in outdoor environments: A master-slave calibration algorithm

Facial recognition at-a-distance in surveillance scenarios remains an open problem, particularly due to the small number of pixels representing the facial region. The use of pan-tilt-zoom (PTZ) cameras has been advocated to solve this problem, however, the existing approaches either rely on rough approximations or additional constraints to estimate the mapping between image coordinates and pan-tilt parameters. In this paper, we aim at extending PTZ-assisted facial recognition to surveillance scenarios by proposing a master-slave calibration algorithm capable of accurately estimating pan-tilt parameters without depending on additional constraints. Our approach exploits geometric cues to automatically estimate subjects height and thus determine their 3D position. Experimental results show that the presented algorithm is able to acquire high-resolution face images at a distance ranging from 5 to 40 meters with high success rate. Additionally, we certify the applicability of the aforementioned algorithm to biometric recognition through a face recognition test, comprising 20 probe subjects and 13,020 gallery subjects.

[1]  Ian D. Reid,et al.  Single View Metrology , 2000, International Journal of Computer Vision.

[2]  Carlo S. Regazzoni,et al.  Cooperative multisensor system for real-time face detection and tracking in uncontrolled conditions , 2005, IS&T/SPIE Electronic Imaging.

[3]  Anil K. Jain,et al.  Face Tracking and Recognition at a Distance: A Coaxial and Concentric PTZ Camera System , 2013, IEEE Transactions on Information Forensics and Security.

[4]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Yu Liu,et al.  A Master-Slave Surveillance System to Acquire Panoramic and Multiscale Videos , 2014, TheScientificWorldJournal.

[6]  Sharath Pankanti,et al.  Face cataloger: multi-scale imaging for relating identity to location , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[7]  Rainer Stiefelhagen,et al.  Automatic Person Detection and Tracking using Fuzzy Controlled Active Cameras , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Anil K. Jain,et al.  PTZ camera assisted face acquisition, tracking & recognition , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[9]  Max Lu,et al.  Acquiring Multi-Scale Images by Pan-Tilt-Zoom Control and Automatic Multi-Camera Calibration , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[10]  Peter H. Tu,et al.  Face recognition at a distance system for surveillance applications , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[11]  T. Kanade,et al.  A master-slave system to acquire biometric imagery of humans at distance , 2003, IWVS '03.

[12]  Amit K. Roy-Chowdhury,et al.  Collaborative Sensing in a Distributed PTZ Camera Network , 2012, IEEE Transactions on Image Processing.

[13]  Dezhen Song,et al.  Systems and algorithms for autonomous and scalable crowd surveillance using robotic PTZ cameras assisted by a wide-angle camera , 2010, Auton. Robots.

[14]  Hsien-Chou Liao,et al.  A New Calibration Method and its Application for the Cooperation of Wide-Angle and Pan-Tilt-Zoom Cameras , 2008 .

[15]  Alberto Del Bimbo,et al.  Exploiting distinctive visual landmark maps in pan-tilt-zoom camera networks , 2010, Comput. Vis. Image Underst..

[16]  Yuan-Fang Wang,et al.  Using Stationary-Dynamic Camera Assemblies for Wide-area Video Surveillance and Selective Attention , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[17]  Wang Jia,et al.  Automatic Weak Calibration of Master-Slave Surveillance System Based on Mosaic Image , 2010, 2010 20th International Conference on Pattern Recognition.

[18]  Nikolaos Papanikolopoulos,et al.  Dual-camera system for multi-level activity recognition , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[19]  Ramakant Nevatia,et al.  Self-calibration of a camera from video of a walking human , 2002, Object recognition supported by user interaction for service robots.

[20]  Gérard G. Medioni,et al.  Towards a practical PTZ face detection and tracking system , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[21]  Zoran Zivkovic,et al.  Improved adaptive Gaussian mixture model for background subtraction , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[22]  Nikolaos Papanikolopoulos,et al.  Multi-Camera Human Activity Monitoring , 2008, J. Intell. Robotic Syst..

[23]  Karl Ricanek,et al.  MORPH: a longitudinal image database of normal adult age-progression , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).