Generating facial expressions of another person based on estimation of muscular contraction parameters from face image

We aim to generate facial expressions of various persons more naturally and without any markers and feature lines. We propose a new approach to estimating muscular contraction parameters for the purpose of generating facial expressions. The muscles of the face are commonly known as the muscles of facial expression. The facial expressions of a human are generated by muscle movements inside the face. If the muscle-based facial model that Waters proposed is used, facial expressions can be generated by muscular contraction parameters. In this paper, first, the facial surface feature points of the face images are detected by imageprocessing methods. Next, the muscular contraction parameters are estimated by the neutral expression and arbitrary expression displacement of the facial model wireframe fitting, based on detected facial surface feature points. Finally, the facial expression is generated by the vertex displacements of an individual facial model based on estimated muscular contraction parameters. Experimental results reveal that our approach can generate various facial expressions of the individual facial model, which corresponds to the facial expression of the actual face image. Additionally, we can generate the facial expressions of another person by using the muscular contraction parameters of that person in an individual facial model. © 2007 Wiley Periodicals, Inc. Syst Comp Jpn, 38(12): 66–75, 2007; Published online in Wiley InterScience (www.interscience.wiley.com). DOI 10.1002/scj.20647

[1]  Masahide Kaneko,et al.  Processing of facial information by computer , 1998 .

[2]  Keith Waters,et al.  A muscle model for animation three-dimensional facial expression , 1987, SIGGRAPH.

[3]  Shigeo Morishima,et al.  3D Face Expression Estimation and Generation from 2D Image Based on a Physically Constraint Model , 2000 .

[4]  Yu Zhang,et al.  A new physical model with multilayer architecture for facial expression animation using dynamic adaptive mesh , 2004, IEEE Transactions on Visualization and Computer Graphics.

[5]  Demetri Terzopoulos,et al.  Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Shigeo Morishima,et al.  Facial image reconstruction by estimated muscle parameter , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[7]  Shigeo Morishima,et al.  Facial muscle parameter decision from 2D frontal image , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[8]  Keith Waters,et al.  Computer facial animation , 1996 .

[9]  Hong Yan,et al.  NURBS curve controlled modelling for facial animation , 2003, Comput. Graph..

[10]  Hiroshi Harashima,et al.  Analysis of facial expressions using a three-dimensional facial model , 1992, Systems and Computers in Japan.

[11]  Shinji Ozawa,et al.  Generating facial expressions based on estimation of muscular contraction parameters from facial feature points , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).