Point Clouds Based 3D Facial Expression Generation

Our research in this paper is a new method for facial expression generation based upon extrinsic and intrinsic information with the advantages of direct processing of Point Clouds (PCs). In our pipeline of facial expression generation, there is no need to set up a face model or facial expression database in advance or to construct any mesh or surface models. The basic idea of our method is that the animation of facial expression is achieved by a combination of Global Face Motion and Local Face Motion. In the former, Global Face Motion can be decided by the ICP algorithm, while the latter takes charge of partial movements on the face. Finding correct corresponding points is important for generating an intermediate face from two different facial expressions. This process yields in a good result of the interpolated PCs for facial expression generation between two different facial PCs. Finally, the experimental result shows fairly satisfactory facial expression generation.

[1]  Hiroshi Masuda,et al.  Interactive Mesh Deformation that Preserves Visual Saliency , 2009 .

[2]  Markus H. Gross,et al.  Pose-space animation and transfer of facial details , 2008, SCA '08.

[3]  Prem Kalra,et al.  MODEL BASED FACE RECONSTRUCTION FOR ANIMATION , 1999 .

[4]  Günther Greiner,et al.  Reconstructing Animated Meshes from Time‐Varying Point Clouds , 2008, Comput. Graph. Forum.

[5]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[6]  Alex Pentland,et al.  Coding, Analysis, Interpretation, and Recognition of Facial Expressions , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Hans-Peter Seidel,et al.  Head shop: generating animated head models with anatomical structure , 2002, SCA '02.

[8]  Robert B. Fisher,et al.  Estimating 3-D rigid body transformations: a comparison of four major algorithms , 1997, Machine Vision and Applications.

[9]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Luc Van Gool,et al.  Face/Off: live facial puppetry , 2009, SCA '09.

[11]  Markus Gross,et al.  Point-Based Graphics , 2007 .

[12]  Pascal Fua,et al.  Using Dirichlet Free Form Deformation to Fit Deformable Models to Noisy 3-D Data , 2002, ECCV.

[13]  Hans-Peter Seidel,et al.  Isometric registration of ambiguous and partial data , 2009, CVPR.

[14]  Wojciech Matusik,et al.  Multi-scale capture of facial geometry and motion , 2007, ACM Trans. Graph..

[15]  Paul S. Heckbert,et al.  Using particles to sample and control implicit surfaces , 1994, SIGGRAPH Courses.

[16]  Joachim Loos,et al.  Data Dependent Thin Plate Energy and its use in Interactive Surface Modeling , 1996, Comput. Graph. Forum.

[17]  Ramesh C. Jain,et al.  Invariant surface characteristics for 3D object recognition in range images , 1985, Comput. Vis. Graph. Image Process..

[18]  M. Teschner,et al.  Meshless deformations based on shape matching , 2005, SIGGRAPH 2005.

[19]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[20]  Nadia Magnenat-Thalmann,et al.  Fast head modeling for animation , 2000, Image Vis. Comput..