Synthesis of a face image at a desired pose from a given pose

This paper proposes an efficient method to synthesize pose of an image. Pose synthesis is used to predict the face image with minimal error at a desired pose from a given pose. It is frequently required in many applications like production of animated movies, in forensic science and generation of 3D face geometry, etc. It uses principal component analysis (PCA) in conjunction with linear object classes (LOC) method (Vetter and Poggio, 1997). The face image of a pose is modelled as shape and texture vectors and the LOC method is applied on these two vectors of training set separately. The principal components of shape vector give a smaller number of significant dimensions along which the best linear approximation using LOC for the shape vector is calculated. Even though the given vector is approximated using only these dimensions, the error in approximation is significantly less compared to approximating pose image using all dimensions of shape vector. The proposed method is tested on CMU PIE face database and it is found to be significant improvement over the well known linear object classes method.

[1]  Takeo Kanade,et al.  3D Alignment of Face in a Single Image , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[2]  Rabab Kreidieh Ward,et al.  Face recognition under pose variations , 2006, J. Frankl. Inst..

[3]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression Database , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Wen Gao,et al.  Locally Linear Regression for Pose-Invariant Face Recognition , 2007, IEEE Transactions on Image Processing.

[5]  Tomaso A. Poggio,et al.  Linear Object Classes and Image Synthesis From a Single Example Image , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Michael J. Black,et al.  EigenTracking: Robust Matching and Tracking of Articulated Objects Using a View-Based Representation , 1996, International Journal of Computer Vision.

[7]  David Beymer,et al.  Vectorizing Face Images by Interleaving Shape and Texture Computations , 1995 .

[8]  Seong-Whan Lee,et al.  Reconstruction of Partially Damaged Face Images Based on a Morphable Face Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Li Zhang,et al.  Single view modeling of free-form scenes , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[10]  P. Jonathon Phillips,et al.  Face recognition based on frontal views generated from non-frontal images , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[11]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[12]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Phalguni Gupta,et al.  Frontal face generation from profile face image , 2011, 2011 IEEE International Conference on Anti-Counterfeiting, Security and Identification.

[14]  Tomaso A. Poggio,et al.  Model-based matching of line drawings by linear combinations of prototypes , 1995, Proceedings of IEEE International Conference on Computer Vision.

[15]  Rabab Kreidieh Ward,et al.  Component-wise pose normalization for pose-invariant face recognition , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[16]  Horst Bischof,et al.  Robust Recognition Using Eigenimages , 2000, Comput. Vis. Image Underst..

[17]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[18]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  David Beymer,et al.  Face recognition from one example view , 1995, Proceedings of IEEE International Conference on Computer Vision.

[20]  Steven M. Seitz,et al.  Single-view modelling of free-form scenes , 2002, Comput. Animat. Virtual Worlds.

[21]  Yasuyuki Saito,et al.  Estimation of eyeglassless facial images using principal component analysis , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[22]  Ralph Gross,et al.  Appearance-based face recognition and light-fields , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  T. Poggio,et al.  Recognition and Structure from one 2D Model View: Observations on Prototypes, Object Classes and Symmetries , 1992 .

[24]  Thomas Vetter,et al.  Synthesis of Novel Views from a Single Face Image , 1998, International Journal of Computer Vision.