Analysis and synthesis of human faces with pose variations by a parametric piecewise linear subspace method

A framework for learning an accurate and general parametric facial model from 2D images is proposed and its application for analyzing and synthesizing facial images with pose variation is demonstrated. Our parametric piecewise linear subspace method covers a wide range of pose variation in a continuous manner through a weighted linear combination of local linear models distributed in a pose parameter space. The linear design helps to avoid typical nonlinear pitfalls such as overfitting and time-consuming learning. Experimental results show sub-degree and sub-pixel accuracy within /spl plusmn/55 degree full 3D rotation and good generalization capability over unknown head poses when learned and tested for specific persons.

[1]  Tomaso A. Poggio,et al.  Linear Object Classes and Image Synthesis From a Single Example Image , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Shimon Edelman,et al.  Receptive field spaces and class-based generalization from a single view in face recognition , 1995 .

[4]  Norbert Krüger,et al.  Determination of face position and pose with a learned representation based on labelled graphs , 1997, Image Vis. Comput..

[5]  Shaogang Gong,et al.  Real-time face pose estimation , 1998, Real Time Imaging.

[6]  David Beymer,et al.  Face recognition from one example view , 1995, Proceedings of IEEE International Conference on Computer Vision.

[7]  Alex Pentland,et al.  View-based and modular eigenspaces for face recognition , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Elie Bienenstock,et al.  Neural Networks and the Bias/Variance Dilemma , 1992, Neural Computation.

[9]  Norbert Krüger,et al.  Face Recognition by Elastic Bunch Graph Matching , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Hyeonjoon Moon,et al.  The FERET evaluation methodology for face-recognition algorithms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Norbert Krüger,et al.  Face recognition by elastic bunch graph matching , 1997, Proceedings of International Conference on Image Processing.

[12]  Christoph von der Malsburg,et al.  Single-View Based Recognition of Faces Rotated in Depth , 1995 .

[13]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[14]  Alexander Zelinsky,et al.  3-D facial pose and gaze point estimation using a robust real-time tracking paradigm , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[15]  Christoph von der Malsburg,et al.  Analysis and synthesis of pose variations of human faces by a linear PCMAP model and its application for pose-invariant face recognition system , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[16]  K NayarShree,et al.  Visual learning and recognition of 3-D objects from appearance , 1995 .

[17]  Christoph von der Malsburg,et al.  Reconstruction from Graphs Labeled with Responses of Gabor Filters , 1996, ICANN.

[18]  D. Rubin,et al.  Statistical Analysis with Missing Data. , 1989 .

[19]  Edwin R. Hancock,et al.  Estimating 3D Facial Pose using the EM Algorithm , 1998, BMVC.

[20]  Christopher G. Atkeson,et al.  Constructive Incremental Learning from Only Local Information , 1998, Neural Computation.

[21]  Narendra Ahuja,et al.  Face detection using mixtures of linear subspaces , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[22]  Tomaso Poggio,et al.  Example Based Image Analysis and Synthesis , 1993 .

[23]  Koichiro Deguchi,et al.  Head pose determination from one image using a generic model , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.