Interactive modeling of 3D facial expressions with hierarchical Gaussian process latent variable models

The natural expressions play an important role in the daily communication. The efficient and intuitive facial expression editing based on the limited constraints is desirable in the facial animation. In this paper, we present an interactive 3D facial expression editing system with the hierarchical Gaussian process latent variable model (HGPLVM). The hierarchical model incorporates the joint work of the local facial features to produce the natural expressions. To deal with the holistic expression modeling from the local constraints, the inverse mapping between the low-level feature nodes and the high-level facial region nodes is established by the RBF regression model in the latent space. A propagation algorithm is introduced to predict the holistic facial configurations. The experiments demonstrate the 3D facial expressions satisfying the user constraints can be produced efficiently.

[1]  Neil D. Lawrence,et al.  Hierarchical Gaussian process latent variable models , 2007, ICML '07.

[2]  Harry Shum,et al.  Face poser: interactive modeling of 3D facial expressions using model priors , 2007, SCA '07.

[3]  Aaron Hertzmann,et al.  Style-based inverse kinematics , 2004, ACM Trans. Graph..

[4]  Steven M. Seitz,et al.  Spacetime faces , 2004, ACM Trans. Graph..

[5]  Baining Guo,et al.  Geometry-driven photorealistic facial expression synthesis , 2003, IEEE Transactions on Visualization and Computer Graphics.

[6]  Yuru Pei,et al.  Stylized synthesis of facial speech motions , 2007 .

[7]  Aaron Hertzmann,et al.  Style-based inverse kinematics , 2004, SIGGRAPH 2004.

[8]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[9]  Zhigang Deng,et al.  Orthogonal-Blendshape-Based Editing System for Facial Motion Capture Data , 2008, IEEE Computer Graphics and Applications.

[10]  David J. Fleet,et al.  3D People Tracking with Gaussian Process Dynamical Models , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[11]  Q. Shi,et al.  Gaussian Process Latent Variable Models for , 2011 .