Feature selection for person-independent 3D facial expression recognition using NSGA-II

In this paper, the problem of person-independent facial expression recognition from 3D facial features is investigated. We propose a methodology for the selection of features that uses a multi-objective genetic algorithm where the number of features is optimized to improve classification accuracy. The facial feature selection aims to derive a set of features from the original expression images, which minimizes the within-class separability and maximizes the between-class separability. We used Non-dominated Sorted Genetic Algorithm II (NSGA II) which is one of the latest genetic algorithms developed for resolving problems of multi-objective aspects with more accuracy and higher convergence speed. The proposed methodology is evaluated using 3D facial expression database BU-3DFE. Facial expressions such as anger, sadness, surprise, joy, disgust, fear and neutral are successfully recognized with an average recognition rate of 88.18%.

[1]  Hadi Seyedarabi,et al.  Facial Expressions Recognition in a Single Static as well as Dynamic Facial Images Using Tracking and Probabilistic Neural Networks , 2006, PSIVT.

[2]  Hasan Demirel,et al.  Facial Expression Recognition Using 3D Facial Feature Distances , 2007, ICIAR.

[3]  Shaogang Gong,et al.  Synthesis and recognition of facial expressions in virtual 3D views , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[4]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[5]  Thomas S. Huang,et al.  Final Report To NSF of the Planning Workshop on Facial Expression Understanding , 1992 .

[6]  Jun Wang,et al.  A 3D facial expression database for facial behavior research , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[7]  H. Demirel,et al.  3D facial expression recognition with geometrically localized facial features , 2008, 2008 23rd International Symposium on Computer and Information Sciences.

[8]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[9]  Huan Liu,et al.  Toward integrating feature selection algorithms for classification and clustering , 2005, IEEE Transactions on Knowledge and Data Engineering.

[10]  Aravind Seshadri,et al.  A FAST ELITIST MULTIOBJECTIVE GENETIC ALGORITHM: NSGA-II , 2000 .

[11]  Maja Pantic,et al.  Facial action recognition for facial expression analysis from static face images , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  Fakhri Karray,et al.  Multi-objective Feature Selection with NSGA II , 2007, ICANNGA.

[13]  Filippo Menczer,et al.  Efficient and Scalable Pareto Optimization by Evolutionary Local Selection Algorithms , 2000, Evolutionary Computation.

[14]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[15]  J. Bornemann,et al.  Matrix singular value decomposition for pole-free solutions of homogeneous matrix equations as applied to numerical modeling methods , 1992, IEEE Microwave and Guided Wave Letters.

[16]  Y. Sun,et al.  A Genetic Algorithm Based Approach for 3D Face Recognition , 2007 .

[17]  Jun Wang,et al.  Static topographic modeling for facial expression recognition and analysis , 2007, Comput. Vis. Image Underst..

[18]  Flávio Bortolozzi,et al.  Unsupervised feature selection using multi-objective genetic algorithms for handwritten word recognition , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[19]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[20]  Franck Davoine,et al.  A solution for facial expression representation and recognition , 2002, Signal Process. Image Commun..

[21]  Michael J. Lyons,et al.  Automatic Classification of Single Facial Images , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Gwen Littlewort,et al.  An approach to automatic recognition of spontaneous facial actions , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[23]  Jun Wang,et al.  3D Facial Expression Recognition Based on Primitive Surface Feature Distribution , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).