3D Personalized Face Modeling Based on KINECT2

As a challenging topic in computer graphics and computer vision, 3D face modeling has been applied in various fields including film and animation production, game development as well as medical analysis. In this paper, we mainly aims at face personalized modeling optimization based on KINECT2. The optimization of the scheme proposed is the mesh deformation based on the differential coordinates constrained by face++ feature points and facial muscle function, namely firstly by extracting the location of feature points on the color image and depth map to obtain the feature information of the personalized face, then aligning the intermediate results of the KINECT2 modeling to the feature information. It is good to keep the local grid differential property, at the same time. In this paper, the automatic UV mapping is realized by means of planar differential mesh deformation, which improves the accuracy and efficiency of manual adjustment of UV coordinates in Maya. The experimental results show that the optimization results are more fit in with the individual face.

[1]  Keith Waters,et al.  A muscle model for animation three-dimensional facial expression , 1987, SIGGRAPH.

[2]  Parke,et al.  Parameterized Models for Facial Animation , 1982, IEEE Computer Graphics and Applications.

[3]  Hao Zhang,et al.  Spectral Methods for Mesh Processing and Analysis , 2007, Eurographics.

[4]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[5]  Olga Sorkine-Hornung,et al.  On Linear Variational Surface Deformation Methods , 2008, IEEE Transactions on Visualization and Computer Graphics.

[6]  Tong-Yee Lee,et al.  Photo-realistic 3D Head Modeling Using Multi-view Images , 2004, ICCSA.

[7]  Ryutarou Ohbuchi,et al.  Watermarking 3D Polygonal Meshes in the Mesh Spectral Domain , 2001, Graphics Interface.

[8]  Thomas W. Sederberg,et al.  Free-form deformation of solid geometric models , 1986, SIGGRAPH.

[9]  R. Huang,et al.  Synthesizing lateral face from frontal facial image using anthropometric estimation , 1997, Proceedings of International Conference on Image Processing.

[10]  Demetri Terzopoulos,et al.  Realistic modeling for facial animation , 1995, SIGGRAPH.

[11]  W. T. Tutte.  How to Draw a Graph , 1963 .

[12]  Bruno Lévy,et al.  Spectral Mesh Processing , 2009, SIGGRAPH '10.