Image-Based Fast 3D Individual Facial Modeling

In this paper, an image-based fast 3D facial modeling algorithm is presented. Different from traditional complex stereo vision procedure, our new method needs only one frontal image for fast 3D modeling without any camera calibration. To extract frontal feature points effectively, we propose an improved Active Shape Models (ASM) method. We can calculate the lateral parameters and estimate the depth information of facial feature points. According to MPEG-4 protocol for 3D face structure, we appoint and deform feature points by Radial Basis functions (RBF) corresponding to the generic model. The texture mapping is carried out with regard to different directional projections to generate the individual face.

[1]  Edmond C. Prakash,et al.  Constructing A Realistic Face Model of An Individual for Expression Animation , 2002 .

[2]  William H. Richardson,et al.  Bayesian-Based Iterative Method of Image Restoration , 1972 .

[3]  Norbert Krüger,et al.  Face recognition by elastic bunch graph matching , 1997, Proceedings of International Conference on Image Processing.

[4]  Nadia Magnenat-Thalmann,et al.  Fast head modeling for animation , 2000, Image Vis. Comput..

[5]  C. Helstrom.  Image Restoration by the Method of Least Squares , 1967 .

[6]  Wang Yangsheng,et al.  Shape localization by statistical learning in the Gabor feature space , 2004, Proceedings 7th International Conference on Signal Processing, 2004. Proceedings. ICSP '04. 2004..

[7]  Norbert Krüger,et al.  Face Recognition by Elastic Bunch Graph Matching , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  B. Rouge,et al.  Image de-blurring and application to SPOT5 THR satellite imaging , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[9]  L. Landweber.  An iteration formula for Fredholm integral equations of the first kind , 1951 .

[10]  R. Huang,et al.  Synthesizing lateral face from frontal facial image using anthropometric estimation , 1997, Proceedings of International Conference on Image Processing.

[11]  Prem Kalra,et al.  MODEL BASED FACE RECONSTRUCTION FOR ANIMATION , 1999 .

[12]  Zicheng Liu,et al.  Rapid modeling of animated faces from video , 2001, Comput. Animat. Virtual Worlds.

[13]  Wen Gao,et al.  Individual 3D face synthesis based on orthogonal photos and speech-driven facial animation , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[14]  Brian Klinkenberg,et al.  A Spatial Filter for the Removal of Striping Artifacts in Digital Elevation Models , 2003 .

[15]  Jie Yan,et al.  Realistic Virtual Face and Body Synthesis , 2000, MVA.

[16]  Huadong Guo,et al.  Destriping CMODIS data by power filtering , 2003, IEEE Trans. Geosci. Remote. Sens..

[17]  Ming Yan,et al.  Ultrasound image deconvolution in symmetrical mirror wavelet bases , 2006, SPIE Medical Imaging.

[18]  Lijun Yin,et al.  Constructing a 3D individualized head model from two orthogonal views , 1996, The Visual Computer.

[19]  S. Lai,et al.  An integrated approach to 3D face model reconstruction from video , 2001, Proceedings IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems.

[20]  Josiane Zerubia,et al.  Satellite image deconvolution using complex wavelet packets , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[21]  Olivier D. Faugeras,et al.  Self-Calibration of a 1D Projective Camera and Its Application to the Self-Calibration of a 2D Projective Camera , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Ruey-Song Huang,et al.  3-D facial model estimation from single front-view facial image , 2002, IEEE Trans. Circuits Syst. Video Technol..

[23]  Heinrich Müller,et al.  Spatial free-form deformation with scattered data interpolation methods , 1992, Comput. Graph..

[24]  L. Lucy.  An iterative technique for the rectification of observed distributions , 1974 .

[25]  Fionn Murtagh,et al.  Deconvolution based on the curvelet transform , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[26]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[27]  Jean-Luc Starck,et al.  Deconvolution of astronomical images using the multiscale maximum entropy method , 1996 .

[28]  Nadia Magnenat-Thalmann,et al.  Generating Animatable 3D Virtual Humans from Photographs , 2000, Comput. Graph. Forum.

[29]  Demetri Terzopoulos,et al.  Constructing Physics-Based Facial Models of Individuals , 1993 .

[30]  Y. Freund,et al.  Discussion of the Paper \additive Logistic Regression: a Statistical View of Boosting" By , 2000 .

[31]  D. Donoho.  Nonlinear Solution of Linear Inverse Problems by Wavelet–Vaguelette Decomposition , 1995 .

[32]  Marc Acheroy,et al.  3D Facial Surface Acquisition by Structured Light , 1999 .