Seeing Mixed Emotions: The Specificity of Emotion Perception From Static and Dynamic Facial Expressions Across Cultures

Although perceivers often agree about the primary emotion that is conveyed by a particular expression, observers may concurrently perceive several additional emotions from a given facial expression. In the present research, we compared the perception of two types of nonintended emotions in Chinese and Dutch observers viewing facial expressions: emotions which were morphologically similar to the intended emotion and emotions which were morphologically dissimilar to the intended emotion. Findings were consistent across two studies and showed that (a) morphologically similar emotions were endorsed to a greater extent than dissimilar emotions and (b) Chinese observers endorsed nonintended emotions more than did Dutch observers. Furthermore, the difference between Chinese and Dutch observers was more pronounced for the endorsement of morphologically similar emotions than of dissimilar emotions. We also obtained consistent evidence that Dutch observers endorsed nonintended emotions that were congruent with the preceding expressions to a greater degree. These findings suggest that culture and morphological similarity both influence the extent to which perceivers see several emotions in a facial expression.

[1]  Kenichi Ito,et al.  Agency and Facial Emotion Judgment in Context , 2013, Personality & social psychology bulletin.

[2]  K. Scherer,et al.  Evidence for universality and cultural variation of differential emotion response patterning. , 1994, Journal of personality and social psychology.

[3]  Harald C. Traue,et al.  Perceived realism of dynamic facial expressions of emotion: Optimal durations for the presentation of emotional onsets and offsets , 2010 .

[4]  K. Scherer,et al.  In the eye of the beholder? Universality and cultural specificity in the expression and perception of emotion. , 2011, International journal of psychology : Journal international de psychologie.

[5]  Judith A. Hall,et al.  Gender differences in judgments of multiple emotions from facial expressions. , 2004, Emotion.

[6]  N. Frijda,et al.  Relations among emotion, appraisal, and emotional action readiness , 1989 .

[7]  J. Russell,et al.  Americans and Palestinians judge spontaneous facial expressions of emotion. , 2013, Emotion.

[8]  David Matsumoto,et al.  American-Japanese Differences in Multiscalar Intensity Ratings of Universal Facial Expressions of Emotion , 1998 .

[9]  H. Triandis,et al.  Multimethod probes of individualism and collectivism. , 1990 .

[10]  Hillary Anger Elfenbein,et al.  On the universality and cultural specificity of emotion recognition: a meta-analysis. , 2002, Psychological bulletin.

[11]  A. Manstead,et al.  Effects of Dynamic Aspects of Facial Expressions: A Review , 2013 .

[12]  P. Ekman,et al.  Facial action coding system , 2019 .

[13]  J. Movellan,et al.  Human and computer recognition of facial expressions of emotion , 2007, Neuropsychologia.

[14]  J. Russell A circumplex model of affect. , 1980 .

[15]  P. Ekman Facial expression and emotion. , 1993, The American psychologist.

[16]  W. Sato,et al.  BRIEF REPORT The dynamic aspects of emotional facial expressions , 2004 .

[17]  R. Nisbett,et al.  Culture, dialectics, and reasoning about contradiction. , 1999 .

[18]  Skyler T. Hawk,et al.  Presentation and validation of the Radboud Faces Database , 2010 .

[19]  A. Manstead,et al.  Social appraisal: the social world as object of and influence on appraisal processes , 2001 .

[20]  J. Cohn,et al.  Deciphering the Enigmatic Face , 2005, Psychological science.

[21]  Jonathan W. Peirce,et al.  PsychoPy—Psychophysics software in Python , 2007, Journal of Neuroscience Methods.

[22]  Skyler T. Hawk,et al.  Moving faces, looking places: validation of the Amsterdam Dynamic Facial Expression Set (ADFES). , 2011, Emotion.

[23]  W. Sato,et al.  Detection of emotional facial expressions and anti-expressions , 2010 .

[24]  J. Russell,et al.  Relativity in the Perception of Emotion in Facial Expressions , 1987 .

[25]  David Matsumoto,et al.  Cultural influences on facial expressions of emotion , 1991 .

[26]  Rachael E. Jack,et al.  Cultural Confusions Show that Facial Expressions Are Not Universal , 2009, Current Biology.

[27]  D. Isaacowitz,et al.  Cultural differences in gaze and emotion recognition: Americans contrast more than Chinese. , 2013, Emotion.

[28]  H. Markus,et al.  Emotion and culture: Empirical studies of mutual influence. , 1994 .

[29]  K. Peng,et al.  Dialectical Self-Esteem and East-West Differences in Psychological Well-Being , 2004, Personality & social psychology bulletin.

[30]  John DeLamater,et al.  Gender and Job Status as Contextual Cues for the Interpretation of Facial Expression of Emotion , 2000 .

[31]  U. Hess,et al.  Cross-Cultural Emotion Recognition among Canadian Ethnic Groups , 2005 .

[32]  G. A. Kleef,et al.  How Emotions Regulate Social Life , 2009 .

[33]  J. Russell,et al.  Core affect, prototypical emotional episodes, and other things called emotion: dissecting the elephant. , 1999, Journal of personality and social psychology.

[34]  B. Mesquita,et al.  Placing the face in context: cultural differences in the perception of facial emotion. , 2008, Journal of personality and social psychology.

[35]  Ran R. Hassin,et al.  Angry, Disgusted, or Afraid? , 2008, Psychological science.

[36]  H. Markus,et al.  Culture and the self: Implications for cognition, emotion, and motivation. , 1991 .

[37]  Klaus R. Scherer,et al.  The perception of changing emotion expressions , 2012, Cognition & emotion.

[38]  Heather C. Lench,et al.  Discrete emotions predict changes in cognition, judgment, experience, behavior, and physiology: a meta-analysis of experimental emotion elicitations. , 2011, Psychological bulletin.

[39]  D. Perrett,et al.  Facial expression megamix: Tests of dimensional and category accounts of emotion recognition , 1997, Cognition.

[40]  R. Nisbett,et al.  Culture, control, and perception of relationships in the environment. , 2000, Journal of personality and social psychology.

[41]  G. A. Kleef The Interpersonal Dynamics of Emotion: Toward an Integrative Theory of Emotions as Social Information , 2018 .

[42]  G. A. Kleef,et al.  When expressions of fake emotions elicit negative reactions: The role of observers' dialectical thinking , 2017 .

[43]  K. Gegenfurtner,et al.  Effects of spatial and temporal context on color categories and color constancy. , 2007, Journal of vision.

[44]  B. Mesquita,et al.  The social roles and functions of emotions , 1994 .

[45]  Craig A. Smith,et al.  From appraisal to emotion: Differences among unpleasant feelings , 1988 .

[46]  P. Ellsworth,et al.  Emotional complexity: Clarifying definitions and cultural correlates. , 2016, Journal of personality and social psychology.

[47]  Yuri Miyamoto,et al.  Culture and mixed emotions: co-occurrence of positive and negative emotions in Japan and the United States. , 2010, Emotion.

[48]  W. Levelt,et al.  The spatial and temporal signatures of word production components , 2004, Cognition.

[49]  Kaiping Peng,et al.  Naïve Dialecticism and the Tao of Chinese Thought , 2006 .

[50]  Sophie K. Scott,et al.  Cross-cultural recognition of basic emotions through nonverbal emotional vocalizations , 2010, Proceedings of the National Academy of Sciences.

[51]  Rachael E. Jack,et al.  Internal representations reveal cultural diversity in expectations of facial expressions of emotion. , 2012, Journal of experimental psychology. General.

[52]  R. Nisbett,et al.  Culture and systems of thought: holistic versus analytic cognition. , 2001, Psychological review.

[53]  P. Ekman,et al.  DIFFERENCES Universals and Cultural Differences in the Judgments of Facial Expressions of Emotion , 2004 .

[54]  Hillary Anger Elfenbein,et al.  When familiarity breeds accuracy: cultural exposure and facial emotion recognition. , 2003, Journal of personality and social psychology.