3D facial expression analysis by using 2D AND 3D wavelet transforms

This work presents a new approach for the 3D human facial expressions analysis. Our methodology is based on 2D and 3D wavelet transforms, which are used to estimate multi-scale features from real a face acquired by a 3D scanner. The proposed methodology starts by considering a dataset composed by faces displaying seven different facial expressions. An automatic pre-processing method, adopting an ellipsoidal cropping, is applied to the dataset. Thereafter, the 2D and 3D descriptors are extracted from different scales of wavelet transforms for the purpose of obtaining the facial expression features. The multi-scale features are represented in a multi-variate feature space, which is analysed by the Sequential Forward Floating Selection algorithm using an entropy criterion function to select the subset of features that best represents each facial expression model. The obtained results corroborate the potential of multi-scale feature extraction for analysis of 3D facial expression.

[1]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[2]  David Correa Martins,et al.  Feature selection environment for genomic applications , 2008, BMC Bioinformatics.

[3]  Jun Wang,et al.  A 3D facial expression database for facial behavior research , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[4]  Luciano da Fontoura Costa,et al.  Robust Skeletonization through Exact Euclidean Distance Transform and its Application to Neuromorphometry , 2000, Real Time Imaging.

[5]  Michael G. Strintzis,et al.  Bilinear elastically deformable models with application to 3D face and facial expression recognition , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[6]  Sílvia Cristina Dias Pinto,et al.  Characterization of neuroanatomic structures using 3D wavelet-based normal fields , 2003, Seventh International Symposium on Signal Processing and Its Applications, 2003. Proceedings..

[7]  Hao Zhang,et al.  Expression-insensitive 3D face recognition using sparse representation , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Raimondo Schettini,et al.  3D face detection using curvature analysis , 2006, Pattern Recognit..

[9]  Sotiris Malassiotis,et al.  Real-time 2D+3D facial action and expression recognition , 2010, Pattern Recognit..

[10]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[11]  A. Grossmann,et al.  Wavelet Transforms and Edge Detection , 1988 .

[12]  Bülent Sankur,et al.  Representation Plurality and Fusion for 3-D Face Recognition , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  Alin Achim,et al.  18th IEEE International Conference on Image Processing, ICIP 2011, Brussels, Belgium, September 11-14, 2011 , 2011, ICIP.

[14]  Arman Savran,et al.  Bosphorus Database for 3D Face Analysis , 2008, BIOID.

[15]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[16]  Jenn-Jier James Lien,et al.  Facial expression recognition system based on rigid and non-rigid motion separation and 3D pose estimation , 2009, Pattern Recognit..

[17]  Michael G. Strintzis,et al.  Bilinear Models for 3-D Face and Facial Expression Recognition , 2008, IEEE Transactions on Information Forensics and Security.