Synthesis of 3D faces using region‐based morphing under intuitive control

This paper presents a new region‐based method for automatically synthesizing varied, natural looking 3D human face models by morphing local facial features according to intuitive control parameters. We automatically compute a one‐to‐one vertex correspondence among the unregistered face scans in a large database by deforming a generic mesh to fit the specific person's face geometry in a global‐to‐local fashion. With the obtained correspondence, we transform the generated data sets of feature shapes into vector space representations. We parameterize the example models using the face anthropometric measurements that reflect the facial physical structure, and predefine the interpolation functions for the parameterized example models based on radial basis functions. At runtime, the interpolation functions are evaluated to efficiently generate the appropriate feature shape by taking the anthropometric parameters as input. We use a shape blending approach for generating a seamlessly deformed mesh around the feature region boundary. The correspondence among all example textures is established by parameterizing the 3D generic mesh over a 2D image domain. The new feature texture with desired attributes is synthesized by interpolating the example textures. Our 3D face synthesis method has several advantages: (1) it regulates the naturalness of synthesized faces, maintaining the quality existing in the real face examples; (2) the region‐based morphing and comprehensive face shape and texture control parameters allow more diverse faces to be generated readily; and (3) the automatic runtime face synthesis is efficient in time complexity and performs fast. Copyright © 2006 John Wiley & Sons, Ltd.

[1]  John P. Lewis,et al.  Pose Space Deformation: A Unified Approach to Shape Interpolation and Skeleton-Driven Deformation , 2000, SIGGRAPH.

[2]  Zoran Popovic,et al.  Articulated body deformation from range scan data , 2002, SIGGRAPH.

[3]  Hans-Peter Seidel,et al.  Head shop: generating animated head models with anatomical structure , 2002, SCA '02.

[4]  Manjula Patel,et al.  FACES: Facial Animation, Construction and Editing System , 1991, Eurographics.

[5]  Zicheng Liu,et al.  Rapid modeling of animated faces from video , 2001, Comput. Animat. Virtual Worlds.

[6]  A. Young,et al.  Configurational Information in Face Perception , 1987, Perception.

[7]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[8]  Daniel Thalmann,et al.  Design, transformation and animation of human faces , 2005, The Visual Computer.

[9]  Takaaki Akimoto,et al.  Automatic creation of 3D facial models , 1993, IEEE Computer Graphics and Applications.

[10]  Parke,et al.  Parameterized Models for Facial Animation , 1982, IEEE Computer Graphics and Applications.

[11]  Nadia Magnenat-Thalmann,et al.  An automatic modeling of human bodies from sizing parameters , 2003, I3D '03.

[12]  Yu Zhang,et al.  An efficient texture generation technique for human head cloning and morphing , 2006, GRAPP.

[13]  Hui Zhang,et al.  Image-based photorealistic 3-D face modeling , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[14]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[15]  Steve DiPaola,et al.  Extending the range of facial types , 1991, Comput. Animat. Virtual Worlds.

[16]  Michael F. Cohen,et al.  Verbs and Adverbs: Multidimensional Motion Interpolation , 1998, IEEE Computer Graphics and Applications.

[17]  Zoran Popovic,et al.  The space of human body shapes: reconstruction and parameterization from range scans , 2003, ACM Trans. Graph..

[18]  L. Farkas Anthropometry of the head and face , 1994 .

[19]  Peter-Pike J. Sloan,et al.  Shape by example , 2001, I3D '01.

[20]  Matthew Stone,et al.  An anthropometric face model using variational techniques , 1998, SIGGRAPH.

[21]  Peter Schröder,et al.  Normal meshes , 2000, SIGGRAPH.

[22]  Richard K. Beatson,et al.  Reconstruction and representation of 3D objects with radial basis functions , 2001, SIGGRAPH.

[23]  Nadia Magnenat-Thalmann,et al.  Fast head modeling for animation , 2000, Image Vis. Comput..