Facial Expression Recognition Using Wavelet Transform and Neural Network Ensemble

The paper presents a facial expression recognition approach based on wavelet transform features and neural network ensemble classifier for the six basic facial expressions from static images of the CMU-PITTSBURGH AU-Coded Face Expression Image Database. Because the facial expression information are mostly concentrate on facial expression information regions, so the mouth, eye and eyebrow regions are segmented from the facial expression images firstly. Then the low-dimension features using wavelet transform and Karhunen-Loeve transform are acquired. A neural network ensemble classifier based on Bagging is constructed finally. The proposed approach has demonstrated superior performance compared to neural networks. The neural network ensemble based classifier yielded an accuracy of 98.5%; the best accuracy obtained from all other neural network based classification schemes tested using the same database.

[1]  Paul Scheunders,et al.  Statistical texture characterization from discrete wavelet representations , 1999, IEEE Trans. Image Process..

[2]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Eric Bauer,et al.  An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants , 1999, Machine Learning.

[4]  Alex Pentland,et al.  Coding, Analysis, Interpretation, and Recognition of Facial Expressions , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Lars Kai Hansen,et al.  Neural Network Ensembles , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Wang Zhiliang Artificial Psychology─A most Accessible Science Research to Human Brain , 2000 .

[7]  Larry S. Davis,et al.  Human expression recognition from motion using a radial basis function network architecture , 1996, IEEE Trans. Neural Networks.

[8]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[9]  Anders Krogh,et al.  Neural Network Ensembles, Cross Validation, and Active Learning , 1994, NIPS.

[10]  P. Ekman,et al.  Constants across cultures in the face and emotion. , 1971, Journal of personality and social psychology.

[11]  Kenji Mase,et al.  Recognition of Facial Expression from Optical Flow , 1991 .

[12]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[13]  Takeo Kanade,et al.  Detection, tracking, and classification of action units in facial expression , 2000, Robotics Auton. Syst..

[14]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[15]  C. Darwin The Expression of the Emotions in Man and Animals , .

[16]  Jesse Hoey,et al.  Hierarchical unsupervised learning of facial expression categories , 2001, Proceedings IEEE Workshop on Detection and Recognition of Events in Video.

[17]  Ioannis Pitas,et al.  Facial Expression Recognition in Image Sequences Using Geometric Deformation Features and Support Vector Machines , 2007, IEEE Transactions on Image Processing.