Application and Evaluation of a 2D+3D Face Authentication System

An end-to-end face authentication system integrating both 2D color images and depth data is presented in this paper, based on a low-cost sensor capable of real-time acquisition of 3D images and associated color images. Depth data is used for robust face detection, localization and 3D pose estimation, as well as for compensating pose and illumination variations of facial images prior to classification. The proposed algorithms were implemented in a pilot security system for access control in real settings. Experimental results show that when normalized images, depicting upright orientation and frontal lighting, are used for authentication, significantly lower error rates are achieved. Moreover, the combination of color and depth data results in increased authentication accuracy, compared to the use of each modality alone.

[1]  Lei Zhang,et al.  Face recognition under variable lighting using harmonic image exemplars , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[2]  Michael G. Strintzis,et al.  Face localization and authentication using color and depth images , 2005, IEEE Transactions on Image Processing.

[3]  Michael G. Strintzis,et al.  Robust face recognition using 2D and 3D data: Pose and illumination compensation , 2005, Pattern Recognit..

[4]  Sang Ryong Kim,et al.  Real-time normalization and feature extraction of 3D face data using curvature characteristics , 2001, Proceedings 10th IEEE International Workshop on Robot and Human Interactive Communication. ROMAN 2001 (Cat. No.01TH8591).

[5]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[6]  Alex Pentland,et al.  Beyond eigenfaces: probabilistic matching for face recognition , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[7]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[8]  Patrick J. Flynn,et al.  Face Recognition Using 2D and 3D Facial Data , 2003 .

[9]  Venu Govindaraju.  Biometrics and Security , 2009, ICISS.

[10]  Michael G. Strintzis,et al.  Real-time acquisition of depth and color images using structured light and its application to 3D face recognition , 2005, Real Time Imaging.

[11]  P. Jonathon Phillips,et al.  Face recognition vendor test 2002 , 2003, 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443).