3D facial model construction and animation from a single frontal face image

In this paper we present a system which automatically generates a 3D face model from a single frontal image of a face with the help of generic 3D model. Our system consists of three components. The first component detects the features like eyes, mouth, eyebrow and contour of face. After detecting features the second component automatically adapts the generic 3d model into face specific 3D model using geometric transformations. Our system allows the rotation and zooming of 3D model and generation of texture. Animation is produced using 3D shape morphing between the corresponding face models and blending the corresponding textures. Our system has the advantage that it is fully automatic, robust and fast. It can be used in a variety of applications for which the accuracy of depths are not critical such as games, avatars, face recognition etc. We have tested and evaluated our system using database BU-3DFE.

[1]  Hyeong-Seok Ko,et al.  Performance-driven muscle-based facial animation , 2001, Comput. Animat. Virtual Worlds.

[2]  Matthew Turk,et al.  A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.

[3]  Parke,et al.  Parameterized Models for Facial Animation , 1982, IEEE Computer Graphics and Applications.

[4]  Frederick I. Parke,et al.  Computer generated animation of faces , 1972, ACM Annual Conference.

[5]  Lijun Yin,et al.  Constructing a 3D individualized head model from two orthogonal views , 1996, The Visual Computer.

[6]  Jun Wang,et al.  A 3D facial expression database for facial behavior research , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[7]  David Salesin,et al.  Synthesizing realistic facial expressions from photographs , 1998, SIGGRAPH.

[8]  Pong C. Yuen,et al.  Recognition of head-and-shoulder face image using virtual frontal-view image , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[9]  Frederick I. Parke,et al.  Computer gernerated animation of faces , 1998 .

[10]  Nadia Magnenat-Thalmann,et al.  Head Modeling from Pictures and Morphing in 3D with Image Metamorphosis Based on Triangulation , 1998, CAPTECH.

[11]  Zicheng Liu.  A Fully Automatic System To Model Faces From a Single Image , 2003 .

[12]  Zhiwei Zhu,et al.  Dynamic Facial Expression Analysis and Synthesis With MPEG-4 Facial Animation Parameters , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Yepeng Guan,et al.  Automatic 3D Face Reconstruction based on Single 2D Image , 2007, 2007 International Conference on Multimedia and Ubiquitous Engineering (MUE'07).

[14]  Anil K. Jain,et al.  Face Detection in Color Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Euiyoung Cha,et al.  Face Detection in Color Image , 2003 .

[16]  Ahmet M. Kondoz,et al.  Automatic Single View-Based 3-D Face Synthesis for Unsupervised Multimedia Applications , 2008, IEEE Transactions on Circuits and Systems for Video Technology.