Video-Based Fast 3 D Individual Facial Modeling

In this paper, we present a video-based fast 3D facial modeling algorithm. Different from traditional complex stereo vision procedure, our new method needs only one frontal image for fast 3D modeling without any camera calibration. The proposed method has three steps. Firstly we propose an improved Active Shape Models (ASM) method to extract frontal feature points. Then according to MPEG-4 protocol for 3D face structure, we appoint and deform feature points by Radial Basis functions (RBF) corresponding to the generic model. At last the texture mapping is carried out with regard to different directional projections. The experiments demonstrate that our new algorithm can fast photorealistically render 3D face with very limited computation.

[1]  Nadia Magnenat-Thalmann,et al.  Generating Animatable 3D Virtual Humans from Photographs , 2000, Comput. Graph. Forum.

[2]  Norbert Krüger,et al.  Face Recognition by Elastic Bunch Graph Matching , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Demetri Terzopoulos,et al.  Constructing Physics-Based Facial Models of Individuals , 1993 .

[4]  Olivier D. Faugeras,et al.  Self-Calibration of a 1D Projective Camera and Its Application to the Self-Calibration of a 2D Projective Camera , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Jie Yan,et al.  Realistic Virtual Face and Body Synthesis , 2000, MVA.

[6]  Heinrich Müller,et al.  Spatial free-form deformation with scattered data interpolation methods , 1992, Comput. Graph..

[7]  Marc Acheroy,et al.  3D Facial Surface Acquisition by Structured Light , 1999 .

[8]  Lijun Yin,et al.  Constructing a 3D individualized head model from two orthogonal views , 1996, The Visual Computer.

[9]  Norbert Krüger,et al.  Face Recognition by Elastic Bunch Graph Matching , 1997, CAIP.

[10]  Wen Gao,et al.  Individual 3D face synthesis based on orthogonal photos and speech-driven facial animation , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[11]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[12]  Prem Kalra,et al.  MODEL BASED FACE RECONSTRUCTION FOR ANIMATION , 1999 .

[13]  Edmond C. Prakash,et al.  Constructing A Realistic Face Model of An Individual for Expression Animation , 2002 .

[14]  Nadia Magnenat-Thalmann,et al.  Fast head modeling for animation , 2000, Image Vis. Comput..

[15]  S. Lai,et al.  An integrated approach to 3D face model reconstruction from video , 2001, Proceedings IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems.

[16]  Zicheng Liu,et al.  Rapid modeling of animated faces from video , 2001, Comput. Animat. Virtual Worlds.