Real-time acquisition of high quality face sequences from an active pan-tilt-zoom camera

Traditional still camera-based facial image acquisition systems in surveillance applications produce low quality face images. This is mainly due to the distance between the camera and subjects of interest. Furthermore, people in such videos usually move around, change their head poses, and facial expressions. Moreover, the imaging conditions like illumination, occlusion, and noise may change. These all aggregate the quality of most of the detected face images in terms of measures like resolution, pose, brightness, and sharpness. To deal with these problems this paper presents an active camera-based realtime high-quality face image acquisition system, which utilizes pan-tilt-zoom parameters of a camera to focus on a human face in a scene and employs a face quality assessment method to log the best quality faces from the captured frames. The system consists of four modules: face detection, camera control, face tracking, and face quality assessment before logging. Experimental results show that the proposed system can effectively log the high quality faces from the active camera in real-time (an average of 61.74ms was spent per frame) with an accuracy of 85.27% compared to human annotated data.

[1]  Thomas B. Moeslund,et al.  Complete face logs for video sequences using face quality measures , 2009 .

[2]  Gérard G. Medioni,et al.  Real time tracking using an active pan-tilt-zoom network camera , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Brian C. Lovell,et al.  Real-Time Face Detection and Tracking for High Resolution Smart Camera System , 2007, 9th Biennial Conference of the Australian Pattern Recognition Society on Digital Image Computing Techniques and Applications (DICTA 2007).

[4]  Kai-Kuang Ma,et al.  A survey on super-resolution imaging , 2011, Signal Image Video Process..

[5]  Afef Salhi,et al.  Object Tracking System Using Camshift, Meanshift and Kalman Filter , 2012 .

[6]  コーコラン,ピーター,et al.  Real-time Face Tracking in a digital image acquisition device , 2007 .

[7]  Thomas B. Moeslund,et al.  Face Quality Assessment System in Video Sequences , 2008, BIOID.

[8]  J. Elder,et al.  Towards Face Recognition at a Distance , 2006 .

[9]  Jong-Hwan Kim,et al.  Fast and Robust Face Detection Using Evolutionary Pruning , 2008, IEEE Transactions on Evolutionary Computation.

[10]  Gérard G. Medioni,et al.  High resolution face sequences from a PTZ network camera , 2011, Face and Gesture 2011.

[11]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[12]  Alberto Del Bimbo,et al.  Posterity Logging of Face Imagery for Video Surveillance , 2012, IEEE MultiMedia.

[13]  Anil K. Jain,et al.  Handbook of Face Recognition, 2nd Edition , 2011 .

[14]  Natalia A. Schmid,et al.  Near real-time face detection and recognition using a wireless camera network , 2012, Defense + Commercial Sensing.

[15]  Brian C. Lovell,et al.  Face detection system design for real time high resolution smart camera , 2009, 2009 Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC).

[16]  Yongkang Wong,et al.  Patch-based probabilistic image quality assessment for face selection and improved video-based face recognition , 2011, CVPR 2011 WORKSHOPS.

[17]  Paramveer S. Dhillon Robust Real-Time Face Tracking Using an Active Camera , 2009, CISIS.

[18]  Peyman Milanfar,et al.  Super-resolution imaging , 2011 .

[19]  Peter H. Tu,et al.  Face recognition at a distance system for surveillance applications , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[20]  Sridha Sridharan,et al.  Efficient real-time face detection for high resolution surveillance applications , 2012, 2012 6th International Conference on Signal Processing and Communication Systems.

[21]  Shutao Li,et al.  Near Infrared Face Image Quality Assessment System of Video Sequences , 2011, 2011 Sixth International Conference on Image and Graphics.