Analysis of in- and out-group differences between Western and East-Asian facial expression recognition

Recent cross-cultural studies have questioned the cultural universality of facial expressions from a psychological viewpoint. However, the automatic facial expression recognition (FER) systems are based on the assumption that facial expressions are the same for all human beings, excluding the differences that may appear between different races and cultures. Therefore, this paper presents an analysis of culturally specific facial expression recognition focused on Western and East-Asian expressive faces using an automatic FER system based on 3 different feature extraction methods (appearance-, geometric-, and a proposed hybrid-based). Our study is focused on 4 specific facial regions (eyes-eyebrows, mouth, nose and forehead/outline) and it is powered by Principal Component Analysis (PCA) which enables the visual examination of the most relevant differences among the 6 basic expressions from each racial group. Feature extraction methods are evaluated using Support Vector Machines (SVM) and 4 standard databases. In addition, our findings are compared with a cross-cultural human study applied to 40 participants from both racial groups.

[1]  Masahide Kaneko,et al.  Facial Expression Recognition Based on Facial Region Segmentation and Modal Value Approach , 2014, IEICE Trans. Inf. Syst..

[2]  P. Ekman.  An argument for basic emotions , 1992 .

[3]  Oliver G. B. Garrod,et al.  Facial expressions of emotion are not culturally universal , 2012, Proceedings of the National Academy of Sciences.

[4]  Maja Pantic,et al.  Facial Expression Recognition , 2009, Encyclopedia of Biometrics.

[5]  Masahide Kaneko,et al.  Computerized Facial Caricatures , 2008 .

[6]  D. Sauter,et al.  Commonalities outweigh differences in the communication of emotions across human cultures [Letter to the editor] , 2013 .

[7]  P. Ekman,et al.  Matsumoto and Ekman's Japanese and Caucasian Facial Expressions of Emotion (JACFEE): Reliability Data and Cross-National Differences , 1997 .

[8]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[9]  C. Darwin.  The Expression of the Emotions in Man and Animals , .

[10]  Andrew J. Calder,et al.  PII: S0042-6989(01)00002-5 , 2001 .

[11]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[12]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[13]  Michael J. Lyons,et al.  Evidence and a computational explanation of cultural differences in facial expression recognition. , 2010, Emotion.