Real-time normalization and feature extraction of 3D face data using curvature characteristics

The method of normalization and real-time feature extraction of 3D face data (range data) is presented. The step of normalization of range data is performed first using the symmetry of the defined facial section pattern and characteristics of changes of the pattern according to head rotations. Normalization of the data for head rotations can not only give strong constraints on the positions official features but also reduce the dimension of parameters used in the deformable template matching. Facial features are found in a range image, which is obtained by projection of the normalized range data, using the deformable templates of eyes, nose and mouth. For reliable feature detection, surface curvatures which can represent a local surface shape are used in this step. We define the energy functions of each template and the conditions of major control points using curvature information. Finally, the facial features are positioned in 3D space by back-mapping to the original range data. The back-mapping is the inverse process of getting the facial range image.

[1]  Marc Acheroy,et al.  Automatic 3D face authentication , 2000, Image Vis. Comput..

[2]  Demetri Terzopoulos,et al.  Realistic modeling for facial animation , 1995, SIGGRAPH.

[3]  Yasushi Yagi,et al.  Active contour model for extracting human faces , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[4]  Marcel J. T. Reinders,et al.  Transformation of a general 3D facial model to an actual scene face , 1992, Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol. III. Conference C: Image, Speech and Signal Analysis,.

[5]  Feng Han,et al.  3D human face recognition using point signature , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[6]  Timothy F. Cootes,et al.  Statistical models of appearance for computer vision , 1999 .

[7]  I. Masuda,et al.  3D facial image analysis for human identification , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[8]  Laurent D. Cohen,et al.  Finite-Element Methods for Active Contour Models and Balloons for 2-D and 3-D Images , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  A. Yuille,et al.  Two- and Three-Dimensional Patterns of the Face , 2001 .

[10]  Hiromi T. Tanaka,et al.  Curvature-based face surface recognition using spherical correlation-principal directions for curved object recognition , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[11]  Kunihito Kato,et al.  On the detection of feature points of 3D facial image and its application to 3D facial caricature , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).