Automatic 3D face texture mapping framework from single image

This paper proposes a novel face texture mapping framework for 3D face reconstruction from a single frontal view or half-profile view facial image. Face reconstruction method that originates from the proposed framework, unlike most of the existing ones, is novel in the sense that it is not tightly coupled to a specific face model, and yet it simplifies the pose estimation problem which is pivotal to the success of face reconstruction. This paper details the proposed framework, and illustrates how it addresses the ill-posed pose estimation problem, of which the solution is optimal in the least square sense. With accurate pose estimation of face, precise texture mapping is thus made possible to allow photo realistic rendering of face images in the 3D space. Experimental results demonstrates that reliable and photo realistic 3D face reconstruction can be easily realized in our framework by utilizing a generic 3D face model, standard Haar-like feature based detector and active appearance model. With proposed frame work, face recognition systems could be more robust to pose changes by reconstructing frontal faces from non-frontal ones.

[1]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Timothy F. Cootes,et al.  Active Appearance Models , 1998, ECCV.

[3]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[4]  Yuxiao Hu,et al.  Automatic 3D reconstruction for face recognition , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[5]  Timothy F. Cootes,et al.  View-based active appearance models , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[6]  Hong Yan,et al.  An Analytic-to-Holistic Approach for Face Recognition Based on a Single Frontal View , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Yuxiao Hu,et al.  Minimum variance estimation of 3D face shape from multi-view , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[8]  Marios Savvides,et al.  3D face econstruction from a single 2D face image , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.