Automatic Asymmetric 3D-2D Face Recognition

3D Face recognition has been considered as a major solution to deal with unsolved issues of reliable 2D face recognition in recent years, i.e. lighting and pose variations. However, 3D techniques are currently limited by their high registration and computation cost. In this paper, an asymmetric 3D-2D face recognition method is presented, enrolling in textured 3D whilst performing automatic identification using only 2D facial images. The goal is to limit the use of 3D data to where it really helps to improve face recognition accuracy. The proposed approach contains two separate matching steps: Sparse Representation Classifier (SRC) is applied to 2D-2D matching, while Canonical Correlation Analysis (CCA) is exploited to learn the mapping between range LBP faces (3D) and texture LBP faces (2D). Both matching scores are combined for the final decision. Moreover, we propose a new preprocessing pipeline to enhance robustness to lighting and pose effects. The proposed method achieves better experimental results in the FRGC v2.0 dataset than 2D methods do, but avoiding the cost and inconvenience of data acquisition and computation of 3D approaches.

[1]  Jean-Luc Dugelay,et al.  Asymmetric 3D/2D Processing: A Novel Approach for Face Recognition , 2005, ICIAP.

[2]  Shengcai Liao,et al.  Heterogeneous Face Recognition from Local Structures of Normalized Appearance , 2009, ICB.

[3]  John Shawe-Taylor,et al.  Canonical Correlation Analysis: An Overview with Application to Learning Methods , 2004, Neural Computation.

[4]  Zhen Lei,et al.  Coupled Spectral Regression for matching heterogeneous faces , 2009, CVPR.

[5]  Ke Huang,et al.  Sparse Representation for Signal Classification , 2006, NIPS.

[6]  Liming Chen,et al.  New Experiments on ICP-Based 3D Face Recognition and Authentication , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[7]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[8]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[9]  Stan Z. Li,et al.  2D–3D face matching using CCA , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[10]  Stefano Tubaro,et al.  Mixed 2D-3D Information for Pose Estimation and Face Recognition , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[11]  Stan Z. Li,et al.  Coupled Spectral Regression for matching heterogeneous faces , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Simon Baker,et al.  Active Appearance Models Revisited , 2004, International Journal of Computer Vision.

[13]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  Remco C. Veltkamp,et al.  A Survey of 3D Face Recognition Methods , 2005, AVBPA.

[15]  Dorin Comaniciu,et al.  Total variation models for variable lighting face recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  W. Marsden I and J , 2012 .

[18]  Horst Bischof,et al.  3D and Infrared Face Reconstruction from RGB data using Canonical Correlation Analysis , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[19]  Liming Chen,et al.  Asymmetric 3D/2D face recognition based on LBP facial representation and canonical correlation analysis , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[20]  Ieee Xplore,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Information for Authors , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Stan Z. Li,et al.  An Analysis-by-Synthesis Method for Heterogeneous Face Biometrics , 2009, ICB.

[22]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..