3-D facial model estimation from single front-view facial image

A 3-D facial model can be accurately obtained from: (1) stereo facial images or (2) front- and side-view facial images. The stereo images can be obtained by two different cameras at the same time. On the other hand, capturing front- and side-view facial images requires precise location of the camera. Either may be unavailable in many practical applications. We modify several existing techniques to automatically locate the feature point position from the front-view facial image. Then several schemes (such as minimum mean square error, minimum mean absolute error, and maximum a posteriori) are used to estimate the "depth" information of the 3-D facial model parameters from the single front-view facial image according to the anthropometric and a priori information. With this scheme, a 3-D facial model can be estimated from single front-view facial image. According to the simulation results, the estimated facial model matches the exact 3-D facial model, and the synthesized and original side-view facial images appear similar.

[1]  Paul Juell,et al.  A hierarchical neural network for human face detection , 1996, Pattern Recognit..

[2]  Thomas Sikora,et al.  MPEG digital video-coding standards , 1997, IEEE Signal Process. Mag..

[3]  Hong Yan,et al.  Locating and extracting the eye in human face images , 1996, Pattern Recognit..

[4]  Kiyoharu Aizawa,et al.  Model-based image coding advanced video coding techniques for very low bit-rate applications , 1995, Proc. IEEE.

[5]  Ioannis Pitas,et al.  Digital Image Processing Algorithms , 1993 .

[6]  Thomas Sikora,et al.  Digital video coding standards and their role in video communications , 1995, Proc. IEEE.

[7]  Kiyoharu Aizawa,et al.  Model-based analysis synthesis image coding (MBASIC) system for a person's face , 1989, Signal Process. Image Commun..

[8]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Haiyuan Wu,et al.  Automatic detection of facial feature points and contours , 1996, Proceedings 5th IEEE International Workshop on Robot and Human Communication. RO-MAN'96 TSUKUBA.

[10]  Robert Forchheimer,et al.  Image coding-from waveforms in animation , 1989, IEEE Trans. Acoust. Speech Signal Process..

[11]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[12]  Jörn Ostermann,et al.  Object-based analysis-synthesis coding based on the source model of moving rigid 3D objects , 1994, Signal Process. Image Commun..

[13]  Thomas S. Huang,et al.  Automatic construction of 3D human face models based on 2D images , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[14]  A. Zakhor,et al.  Depth based recovery of human facial features from video sequences , 1995, Proceedings., International Conference on Image Processing.

[15]  Thomas S. Huang,et al.  Human face detection in a complex background , 1994, Pattern Recognit..

[16]  Montse Pardàs,et al.  Hierarchical morphological segmentation for image sequence coding , 1994, IEEE Trans. Image Process..

[17]  D. E. Pearson,et al.  Developments in model-based video coding , 1995, Proc. IEEE.

[18]  Kiyoharu Aizawa,et al.  Analysis and synthesis of facial image sequences in model-based image coding , 1994, IEEE Trans. Circuits Syst. Video Technol..

[19]  Jean-Philippe Tarel,et al.  From 2D images to 3D face geometry , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[20]  Takaaki Akimoto,et al.  Automatic creation of 3D facial models , 1993, IEEE Computer Graphics and Applications.

[21]  Xiaobo Li,et al.  Towards a system for automatic facial feature detection , 1993, Pattern Recognit..