Facial expression analysis from 3D range images; comparison with the analysis from 2D images and their integration

Even if facial expression analysis from 2D luminance images is the present mainstream, it has problems due to changes in facial pose and lighting. In this paper, we use 3D range images which do not maintain such problems for facial expression analysis. We first apply the subspace method to range and luminance images, and clarify their differences in image characteristics. Examining the validity of range images for facial expression analysis, we consider improvement in correct classification rates by integrating results from range and luminance images. We employ the linear combination for their integration and show experimental results.

[1]  Alex Pentland,et al.  Face recognition using eigenfaces , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Yasuyuki Saito,et al.  Facial expression analysis by integrating information of feature-point positions and gray levels of facial images , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[3]  Yukiko Kenmochi,et al.  Facial individuality and expression analysis by eigenspace method based on class features or multiple discriminant analysis , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[4]  Hiroshi Harashima,et al.  Analysis of facial expressions using a three-dimensional facial model , 1992, Systems and Computers in Japan.

[5]  Beat Fasel,et al.  Automatic facial expression analysis: a survey , 2003, Pattern Recognit..

[6]  Garrison W. Cottrell,et al.  PCA = Gabor for Expression Recognition , 1999 .