Reconstruction of 3D Human Facial Images Using Partial Differential Equations

One of the challenging problems in geometric modeling and computer graphics is the construction of realistic human facial geometry. Such geometry are essential for a wide range of applications, such as 3D face recognition, virtual reality applications, facial expression simulation and computer based plastic surgery application. This paper addresses a method for the construction of 3D geometry of human faces based on the use of Elliptic Partial Differential Equations (PDE). Here the geometry corresponding to a human face is treated as a set of surface patches, whereby each surface patch is represented using four boundary curves in the 3-space that formulate the appropriate boundary conditions for the chosen PDE. These boundary curves are extracted automatically using 3D data of human faces obtained using a 3D scanner. The solution of the PDE generates a continuous single surface patch describing the geometry of the original scanned data. In this study, through a number of experimental verifications we have shown the efficiency of the PDE based method for 3D facial surface reconstruction using scan data. In addition to this, we also show that our approach provides an efficient way of facial representation using a small set of parameters that could be utilized for efficient facial data storage and verification purposes.

[1]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[2]  Hong Qin,et al.  A shape design system using volumetric implicit PDEs , 2004, Comput. Aided Des..

[3]  Liyan Zhang,et al.  3D face authentication and recognition based on bilateral symmetry analysis , 2005, The Visual Computer.

[4]  Hassan Ugail,et al.  A general 4th-order PDE method to generate Bézier surfaces from the boundary , 2006, Comput. Aided Geom. Des..

[5]  Hassan Ugail,et al.  Techniques for interactive design using the PDE method , 1999, TOGS.

[6]  Stefano Tubaro,et al.  A Model Based Energy Minimization Method for 3D Face Reconstruction , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[7]  Bernd Girod,et al.  Modeling and animation of facial expressions based on B-Splines , 1994, The Visual Computer.

[8]  Hong Yan,et al.  Modeling and animation of human expressions using NURBS curves based on facial anatomy , 2002, Signal Process. Image Commun..

[9]  Wen Gao,et al.  Efficient 3D reconstruction for face recognition , 2005, Pattern Recognit..

[10]  Marc Acheroy,et al.  Automatic 3D face authentication , 2000, Image Vis. Comput..

[11]  Gerald E. Farin,et al.  From conics to NURBS: A tutorial and survey , 1992, IEEE Computer Graphics and Applications.

[12]  Yu Zhang,et al.  Face alive , 2004, J. Vis. Lang. Comput..

[13]  I. Faux,et al.  Computational Geometry for Design and Manufacture , 1979 .

[14]  Markus Gross,et al.  A framework for facial surgery simulation , 1999 .

[15]  Hassan Ugail,et al.  Manipulation of PDE surfaces using an interactively defined parameterisation , 1999, Comput. Graph..

[16]  Michael J. Wilson,et al.  Generating blend surfaces using partial differential equations , 1989 .

[17]  Michael G. Strintzis,et al.  Robust real-time 3D head pose estimation from range data , 2005, Pattern Recognit..

[18]  Nadia Magnenat-Thalmann,et al.  Facial feature extraction for quick 3D face modeling , 2002, Signal Process. Image Commun..

[19]  Li Bai,et al.  3D object modelling for entertainment applications , 2006, ACE '06.

[20]  Michael G. Strintzis,et al.  Real-time head tracking and 3D pose estimation from range data , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[21]  Yu Zhang,et al.  Synthesis of 3D faces using region‐based morphing under intuitive control , 2006, Comput. Animat. Virtual Worlds.

[22]  Nadia Magnenat-Thalmann,et al.  Fast head modeling for animation , 2000, Image Vis. Comput..

[23]  Lijun Yin,et al.  Constructing a 3D individualized head model from two orthogonal views , 1996, The Visual Computer.

[24]  Matthias Eck,et al.  Automatic reconstruction of B-spline surfaces of arbitrary topological type , 1996, SIGGRAPH.

[25]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Demetri Terzopoulos,et al.  Realistic modeling for facial animation , 1995, SIGGRAPH.