Efficient 3D reconstruction for face recognition

Face recognition with variant pose, illumination and expression (PIE) is a challenging problem. In this paper, we propose an analysis-by-synthesis framework for face recognition with variant PIE. First, an efficient two-dimensional (2D)-to-three-dimensional (3D) integrated face reconstruction approach is introduced to reconstruct a personalized 3D face model from a single frontal face image with neutral expression and normal illumination. Then, realistic virtual faces with different PIE are synthesized based on the personalized 3D face to characterize the face subspace. Finally, face recognition is conducted based on these representative virtual faces. Compared with other related work, this framework has following advantages: (1) only one single frontal face is required for face recognition, which avoids the burdensome enrollment work; (2) the synthesized face samples provide the capability to conduct recognition under difficult conditions like complex PIE; and (3) compared with other 3D reconstruction approaches, our proposed 2D-to-3D integrated face reconstruction approach is fully automatic and more efficient. The extensive experimental results show that the synthesized virtual faces significantly improve the accuracy of face recognition with changing PIE.

[1]  Sandor Z. Der,et al.  FERET (Face Recognition Technology) Recognition Algorithm Development and Test Results. , 1996 .

[2]  Demetri Terzopoulos,et al.  The Computation of Visible-Surface Representations , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[4]  Berthold K. P. Horn,et al.  Shape from shading , 1989 .

[5]  P. Jonathon Phillips,et al.  Face recognition vendor test 2002 , 2003, 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443).

[6]  P. Jonathon Phillips,et al.  Empirical Evaluation Methods in Computer Vision , 2002 .

[7]  Penio S. Penev.  Reducing the Dimensionality of Face Space in a Sparse Distributed Local-Features Representation , 2000 .

[8]  Tomaso A. Poggio,et al.  Linear Object Classes and Image Synthesis From a Single Example Image , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  R. Webster,et al.  Kriging: a method of interpolation for geographical information systems , 1990, Int. J. Geogr. Inf. Sci..

[10]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[11]  Shuicheng Yan,et al.  Ranking prior likelihood distributions for Bayesian shape localization framework , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[12]  T. Kanade,et al.  Combining Models and Exemplars for Face Recognition: An Illuminating Example , 2001 .

[13]  Zicheng Liu,et al.  Expressive expression mapping with ratio images , 2001, SIGGRAPH.

[14]  Amnon Shashua,et al.  The Quotient Image: Class-Based Re-Rendering and Recognition with Varying Illuminations , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Ralph Gross,et al.  Quo vadis Face Recognition , 2001 .

[16]  A. Martínez,et al.  The AR face databasae , 1998 .

[17]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Shimon Edelman,et al.  Receptive field spaces and class-based generalization from a single view in face recognition , 1995 .

[19]  Alex Pentland,et al.  View-based and modular eigenspaces for face recognition , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Sami Romdhani,et al.  Face identification across different poses and illuminations with a 3D morphable model , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[21]  Wen Gao,et al.  Animating arbitrary topology 3D facial model using the MPEG-4 FaceDefTables , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[22]  Martin D. Levine,et al.  Face Recognition Using the Discrete Cosine Transform , 2001, International Journal of Computer Vision.

[23]  Paul A. Griffin,et al.  Statistical Approach to Shape from Shading: Reconstruction of Three-Dimensional Face Surfaces from Single Two-Dimensional Images , 1996, Neural Computation.

[24]  D. Casasent,et al.  Nonlinear feature extraction for pattern recognition applications , 1999 .

[25]  Norbert Krüger,et al.  Face recognition by elastic bunch graph matching , 1997, Proceedings of International Conference on Image Processing.

[26]  Rama Chellappa,et al.  SFS based view synthesis for robust face recognition , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[27]  ShashuaAmnon,et al.  The Quotient Image , 2001 .

[28]  Christoph von der Malsburg,et al.  Single-View Based Recognition of Faces Rotated in Depth , 1995 .

[29]  Matthew Turk,et al.  A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.

[30]  Jian-Huang Lai,et al.  Face recognition using holistic Fourier invariant features , 2001, Pattern Recognit..

[31]  David Casasent,et al.  Pose-invariant recognition of faces at unknown aspect views , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[32]  Tony Jebara,et al.  3D Pose Estimation and Normalization for Face Recognition , 1995 .

[33]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression (PIE) database , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[34]  Michael C. Lincoln.  Pose-independent face recognition , 2003 .

[35]  Hong Yan,et al.  An Analytic-to-Holistic Approach for Face Recognition Based on a Single Frontal View , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  P J. Phillips,et al.  Face Recognition Vendor Test 2000: Evaluation Report , 2001 .

[37]  Ping-Sing Tsai,et al.  Shape from Shading: A Survey , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Sami Romdhani,et al.  Face Identification by Fitting a 3D Morphable Model Using Linear Shape and Texture Error Functions , 2002, ECCV.

[39]  金出 武雄,et al.  Picture processing system by computer complex and recognition of human faces , 1974 .

[40]  J AtickJoseph,et al.  Statistical approach to shape from shading , 1996 .