The Facial Action Coding System (FACS) [Ekman et al., 2002] is the leading method for measuring facial movement in behavioral science. FACS has been successfully applied, but not limited to, identifying the differences between simulated and genuine pain, differences betweenwhen people are telling the truth versus lying, and differences between suicidal and non-suicidal patients [Ekman and Rosenberg, 2005]. Successfully recognizing facial actions is recognized as one of the “major” hurdles to overcome, for successful automated expression recognition. How one should represent the face for effective action unit recognition is the main topic of interest in this chapter. This interest is motivated by the plethora of work in existence in other areas of face analysis, such as face recognition [Zhao et al., 2003], that demonstrate the benefit of representation when performing recognition tasks. It is well understood in the field of statistical pattern recognition [Duda et al., 2001] given a fixed classifier and training set that how one represents a pattern can greatly effect recognition performance. The face can be represented in a myriad of ways. Much work in facial action recognition has centered solely on the appearance (i.e., pixel values) of the face given quite a basic alignment (e.g., eyes and nose). In our work we investigate the employment of the Active Appearance Model (AAM) framework [Cootes et al., 2001, Matthews and Baker, 2004] in order to derive effective representations for facial action recognition. Some of the representations we will be employing can be seen in Figure 1. Experiments in this chapter are run across two action unit databases. The CohnKanade FACS-Coded Facial Expression Database [Kanade et al., 2000] is employed to investigate the effect of face representation on posed facial action unit recognition. Posed facial actions are those that have been elicited by asking subjects to deliberately make specific facial actions or expressions. Facial actions are typically recorded under controlled circumstances that include full-face frontal view, good lighting, constrained head movement and selectivity in terms of the type and magnitude of facial actions. Almost all work in automatic facial expression analysis has used posed image data and the Cohn-Kanade database may be the database most widely used [Tian et al., 2005]. The RU-FACS Spontaneous Expression Database is employed to investigate how these same representations affect spontaneous facial action unit recognition. Spontaneous facial actions are representative of “real-world” facial
[1]
Keinosuke Fukunaga,et al.
Introduction to Statistical Pattern Recognition
,
1972
.
[2]
Simon Baker,et al.
Active Appearance Models Revisited
,
2004,
International Journal of Computer Vision.
[3]
Timothy F. Cootes,et al.
Active Appearance Models
,
2001,
IEEE Trans. Pattern Anal. Mach. Intell..
[4]
Takeo Kanade,et al.
Comprehensive database for facial expression analysis
,
2000,
Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).
[5]
Shigeo Abe DrEng.
Pattern Classification
,
2001,
Springer London.
[6]
Timothy F. Cootes,et al.
Active Appearance Models
,
1998,
ECCV.
[7]
Azriel Rosenfeld,et al.
Face recognition: A literature survey
,
2003,
CSUR.
[8]
Gwen Littlewort,et al.
Recognizing facial expression: machine learning and application to spontaneous behavior
,
2005,
2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).
[9]
Takeo Kanade,et al.
Recognizing Action Units for Facial Expression Analysis
,
2001,
IEEE Trans. Pattern Anal. Mach. Intell..
[10]
Takeo Kanade,et al.
Facial Expression Analysis
,
2011,
AMFG.
[11]
Chih-Jen Lin,et al.
A Practical Guide to Support Vector Classication
,
2008
.
[12]
Gwen Littlewort,et al.
Machine learning methods for fully automatic recognition of facial expressions and facial actions
,
2004,
2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).
[13]
J. Cohn,et al.
Automated face analysis by feature point tracking has high concurrent validity with manual FACS coding.
,
1999,
Psychophysiology.
[14]
Marian Stewart Bartlett,et al.
Classifying Facial Actions
,
1999,
IEEE Trans. Pattern Anal. Mach. Intell..
[15]
David G. Stork,et al.
Pattern Classification
,
1973
.
[16]
R. Gibson,et al.
What the Face Reveals
,
2002
.
[17]
B. Braathen,et al.
First steps towards automatic recognition of spontaneous facial action units
,
2001,
PUI '01.
[18]
Changbo Hu,et al.
AAM derived face representations for robust facial action recognition
,
2006,
7th International Conference on Automatic Face and Gesture Recognition (FGR06).