Fast individual face modeling and animation

We present a fast algorithm for individual face modeling and animation. The method mainly has four steps. Firstly, feature points and 2D information are extracted from frontal face by a RealBoost-Gabor ASM method. Then, we propose a novel searching approach based on geometrical measurement, and select the similar generic model from database. We can calculate the lateral parameters and estimate the depth information of facial feature points. And, the corresponding generic model is deformed and texture is remapped to generate the individual face. Finally, we implement Radial Basis Functions (RBF) deformation to retarget the generic animation and generate individual facial animation.

[1]  Zicheng Liu,et al.  Robust and Rapid Generation of Animated Faces from Video Images: A Model-Based Modeling Approach , 2004, International Journal of Computer Vision.

[2]  Wang Yangsheng,et al.  Shape localization by statistical learning in the Gabor feature space , 2004, Proceedings 7th International Conference on Signal Processing, 2004. Proceedings. ICSP '04. 2004..

[3]  Keith Waters,et al.  A muscle model for animation three-dimensional facial expression , 1987, SIGGRAPH.

[4]  Peng Lu,et al.  3D head models retrieval based on geometrical measurement for modeling , 2005, International Conference on Computer Graphics, Imaging and Visualization (CGIV'05).

[5]  Wen Gao,et al.  Individual 3D face synthesis based on orthogonal photos and speech-driven facial animation , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[6]  Sung Yong Shin,et al.  An example-based approach for facial expression cloning , 2003, SCA '03.

[7]  Demetri Terzopoulos,et al.  Realistic modeling for facial animation , 1995, SIGGRAPH.

[8]  S. Lai,et al.  An integrated approach to 3D face model reconstruction from video , 2001, Proceedings IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems.

[9]  Ruey-Song Huang,et al.  3-D facial model estimation from single front-view facial image , 2002, IEEE Trans. Circuits Syst. Video Technol..

[10]  Olivier D. Faugeras,et al.  Self-Calibration of a 1D Projective Camera and Its Application to the Self-Calibration of a 2D Projective Camera , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  David Salesin,et al.  Resynthesizing facial animation through 3D model-based tracking , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[12]  Ulrich Neumann,et al.  Classification and Volume Morphing for Performance-Driven Facial Animation , 1999 .

[13]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.