Evidence and a computational explanation of cultural differences in facial expression recognition.

Facial expressions are crucial to human social communication, but the extent to which they are innate and universal versus learned and culture dependent is a subject of debate. Two studies explored the effect of culture and learning on facial expression understanding. In Experiment 1, Japanese and U.S. participants interpreted facial expressions of emotion. Each group was better than the other at classifying facial expressions posed by members of the same culture. In Experiment 2, this reciprocal in-group advantage was reproduced by a neurocomputational model trained in either a Japanese cultural context or an American cultural context. The model demonstrates how each of us, interacting with others in a particular cultural context, learns to recognize a culture-specific facial expression dialect.

[1]  C. Darwin The Expression of the Emotions in Man and Animals , .

[2]  C. Landis Studies of Emotional Reactions. II. General Behavior and Facial Expression. , 1924 .

[3]  Carney Landis,et al.  STUDIES OF EMOTIONAL REACTIONS: IV. Metabolic Rate , 1925 .

[4]  R. Thouless Experimental Psychology , 1939, Nature.

[5]  H. Schlosberg The description of facial expressions in terms of two dimensions. , 1952, Journal of experimental psychology.

[6]  S. Tomkins,et al.  What and Where are the Primary Affects? Some Evidence for a Theory , 1964, Perceptual and motor skills.

[7]  P. Ekman,et al.  Pan-Cultural Elements in Facial Displays of Emotion , 1969, Science.

[8]  P. Ekman,et al.  Constants across cultures in the face and emotion. , 1971, Journal of personality and social psychology.

[9]  P. Ekman Universals and cultural differences in facial expressions of emotion. , 1972 .

[10]  G. Keppel,et al.  Design and Analysis: A Researcher's Handbook , 1976 .

[11]  W. Friesen,et al.  Cultural differences in facial expressions in a social situation: An experimental test on the concept of display rules. , 1973 .

[12]  P. Ekman Pictures of Facial Affect , 1976 .

[13]  D. Krantz Nebraska symposium on motivation 1977. , 1977, Nebraska Symposium on Motivation. Nebraska Symposium on Motivation.

[14]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[15]  Allen I. Fleishman Confidence Intervals for Correlation Ratios , 1980 .

[16]  G. Hofstede Dimensions of national cultures in fifty countries and three regions , 1983 .

[17]  J. Daugman Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[18]  J. Russell,et al.  Fuzzy Concepts and the Perception of Emotion in Facial Expressions , 1986 .

[19]  J. P. Jones,et al.  An evaluation of the two-dimensional Gabor filter model of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[20]  P. Ekman,et al.  DIFFERENCES Universals and Cultural Differences in the Judgments of Facial Expressions of Emotion , 2004 .

[21]  Stella Ting-Toomey,et al.  Culture and Affective Communication , 1988 .

[22]  Klaus R. Scherer,et al.  Emotional experience in cultural context: A comparison between Europe, Japan, and the United States. , 1988 .

[23]  P. Ekman,et al.  American-Japanese cultural differences in intensity ratings of facial expressions of emotion , 1989 .

[24]  Lawrence Sirovich,et al.  Application of the Karhunen-Loeve Procedure for the Characterization of Human Faces , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  D. Matsumoto Cultural similarities and differences in display rules , 1990 .

[26]  S. Tomkins Affect, imagery, consciousness, Vol. 3: The negative affects: Anger and fear. , 1991 .

[27]  H. Markus,et al.  Culture and the self: Implications for cognition, emotion, and motivation. , 1991 .

[28]  K. Strongman International review of studies on emotion , 1991 .

[29]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[30]  G. Keppel Design and analysis: A researcher's handbook, 3rd ed. , 1991 .

[31]  D. Matsumoto American-Japanese Cultural Differences in the Recognition of Universal Facial Expressions , 1992 .

[32]  Klaus R. Scherer,et al.  What does facial expression express , 1992 .

[33]  David Matsumoto,et al.  The effects of language on judgments of universal facial expressions of emotion , 1992 .

[34]  D. Matsumoto Ethnic differences in affect intensity, emotion judgments, display rule attitudes, and self-reported emotional expression in an American sample , 1993 .

[35]  Joachim M. Buhmann,et al.  Distortion Invariant Object Recognition in the Dynamic Link Architecture , 1993, IEEE Trans. Computers.

[36]  J. Russell,et al.  Canadian, Greek, and Japanese freely produced emotion labels for facial expressions , 1993 .

[37]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[38]  A. J. Fridlund Human Facial Expression: An Evolutionary View , 1994 .

[39]  C. Izard Innate and universal facial expressions: evidence from developmental and cross-cultural research. , 1994, Psychological bulletin.

[40]  A. O'Toole,et al.  Structural aspects of face recognition and the other-race effect , 1994, Memory & cognition.

[41]  A. J. Fridlund IS THERE UNIVERSAL RECOGNITION OF EMOTION FROM FACIAL EXPRESSION? A REVIEW OF THE CROSS-CULTURAL STUDIES , 1994 .

[42]  P. Ekman,et al.  Strong evidence for universals in facial expressions: a reply to Russell's mistaken critique. , 1994, Psychological bulletin.

[43]  J. Russell Facial expressions of emotion: what lies beyond minimal universality? , 1995, Psychological bulletin.

[44]  H. Triandis Individualism And Collectivism , 1995 .

[45]  D. Matsumoto,et al.  Changing Patterns of Individualism and Collectivism in the United States and Japan , 1996 .

[46]  P. Ekman,et al.  Matsumoto and Ekman's Japanese and Caucasian Facial Expressions of Emotion (JACFEE): Reliability Data and Cross-National Differences , 1997 .

[47]  David Matsumoto,et al.  The contribution of individualism vs. collectivism to cross-national differences in display rules* , 1998 .

[48]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[49]  Michael J. Lyons,et al.  Automatic Classification of Single Facial Images , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  D. Verhoeven When familiarity breeds , 1999 .

[51]  Yohtaro Takano,et al.  An unsupported common view: Comparing Japan and the U.S. on individualism/collectivism , 1999 .

[52]  T. Dalgleish,et al.  Handbook of cognition and emotion , 1999 .

[53]  D. Helmeste,et al.  Misinterpretation of facial expression: A cross‐cultural study , 1999, Psychiatry and clinical neurosciences.

[54]  Michael J. Lyons,et al.  The Noh mask effect: vertical viewpoint dependence of facial expression perception , 2000, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[55]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[56]  P. De Silva,et al.  Handbook of Cognition and Emotion , 2001 .

[57]  G. Hofstede Culture′s Consequences: Comparing Values, Behaviors, Institutions and Organizations Across Nations , 2001 .

[58]  Yueqin Huang,et al.  Differential judgement of static facial expressions of emotions in three cultures , 2001, Psychiatry and clinical neurosciences.

[59]  G. Cottrell,et al.  EMPATH: A Neural Network that Categorizes Facial Expressions , 2002, Journal of Cognitive Neuroscience.

[60]  David Matsumoto,et al.  Methodological requirements to test a possible in-group advantage in judging emotions across cultures: comment on Elfenbein and Ambady (2002) and evidence. , 2002, Psychological bulletin.

[61]  G. Loftus Analysis, Interpretation, and Visual Presentation of Experimental Data , 2002 .

[62]  H. Pashler STEVENS' HANDBOOK OF EXPERIMENTAL PSYCHOLOGY , 2002 .

[63]  Hillary Anger Elfenbein,et al.  Is there an in-group advantage in emotion recognition? , 2002, Psychological bulletin.

[64]  Hiroshi Yamada,et al.  American-Japanese cultural differences in judgements of emotional expressions of different intensities , 2002 .

[65]  Hillary Anger Elfenbein,et al.  On the universality and cultural specificity of emotion recognition: a meta-analysis. , 2002, Psychological bulletin.

[66]  Abigail A Marsh,et al.  Nonverbal “Accents” , 2003, Psychological science.

[67]  Hillary Anger Elfenbein,et al.  When familiarity breeds accuracy: cultural exposure and facial emotion recognition. , 2003, Journal of personality and social psychology.

[68]  Hillary Anger Elfenbein,et al.  Cultural Similarity's Consequences , 2003 .

[69]  T. Dalgleish Basic Emotions , 2004 .

[70]  David Matsumoto,et al.  Development and validation of a measure of display rule knowledge: the display rule assessment inventory. , 2005, Emotion.

[71]  D. Matsumoto Scalar Ratings Of Contempt Expressions , 2005 .

[72]  Wei Ji Ma,et al.  Bayesian inference with probabilistic population codes , 2006, Nature Neuroscience.

[73]  Hillary Anger Elfenbein,et al.  Toward a dialect theory: cultural differences in the expression and recognition of posed facial expressions. , 2007, Emotion.

[74]  W. Richards,et al.  Perception as Bayesian Inference , 2008 .

[75]  C. Darwin,et al.  The Expression of the Emotions in Man and Animals , 1956 .