What the face displays: Mapping 28 emotions conveyed by naturalistic expression.

What emotions do the face and body express? Guided by new conceptual and quantitative approaches (Cowen, Elfenbein, Laukka, & Keltner, 2018; Cowen & Keltner, 2017, 2018), we explore the taxonomy of emotion recognized in facial-bodily expression. Participants (N = 1,794; 940 female, ages 18-76 years) judged the emotions captured in 1,500 photographs of facial-bodily expression in terms of emotion categories, appraisals, free response, and ecological validity. We find that facial-bodily expressions can reliably signal at least 28 distinct categories of emotion that occur in everyday life. Emotion categories, more so than appraisals such as valence and arousal, organize emotion recognition. However, categories of emotion recognized in naturalistic facial and bodily behavior are not discrete but bridged by smooth gradients that correspond to continuous variations in meaning. Our results support a novel view that emotions occupy a high-dimensional space of categories bridged by smooth gradients of meaning. They offer an approximation of a taxonomy of facial-bodily expressions, visualized within an online interactive map. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

[1]  C. Osgood.  Dimensionality of the semantic space for communication via facial expressions. , 1966, Scandinavian journal of psychology.

[2]  P. Ekman,et al.  Pan-Cultural Elements in Facial Displays of Emotion , 1969, Science.

[3]  J. Campos,et al.  Maternal emotional signaling: Its effect on the visual cliff behavior of 1-year-olds. , 1985 .

[4]  D. Watson,et al.  Toward a consensual structure of mood. , 1985, Psychological bulletin.

[5]  Craig A. Smith,et al.  Patterns of cognitive appraisal in emotion. , 1985, Journal of personality and social psychology.

[6]  N. Frijda,et al.  Relations among emotion, appraisal, and emotional action readiness , 1989 .

[7]  R. Lazarus.  Emotion and Adaptation , 1991 .

[8]  Ira J. Roseman.  Appraisal determinants of discrete emotions. , 1991 .

[9]  K. Prkachin.  The consistency of facial expressions of pain: a comparison across modalities , 1992, Pain.

[10]  P. Ekman.  An argument for basic emotions , 1992 .

[11]  J. Reeve,et al.  The face of interest , 1993 .

[12]  P. Ekman.  Facial expression and emotion. , 1993, The American psychologist.

[13]  M. Bradley,et al.  Looking at pictures: affective, facial, visceral, and behavioral reactions. , 1993, Psychophysiology.

[14]  J. Russell.  Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies. , 1994, Psychological bulletin.

[15]  D. Keltner.  Signs of appeasement: evidence for the distinct displays of embarrassment, amusement, and shame , 1995 .

[16]  R. MacCallum,et al.  Sample size in factor analysis. , 1999 .

[17]  Karen L. Schmidt,et al.  Human facial expressions as adaptations: Evolutionary questions in facial expression research. , 2001, American journal of physical anthropology.

[18]  D. Keltner,et al.  Love and the commitment problem in romantic relations and friendship. , 2001, Journal of personality and social psychology.

[19]  Hillary Anger Elfenbein,et al.  On the universality and cultural specificity of emotion recognition: a meta-analysis. , 2002, Psychological bulletin.

[20]  L. Diamond.  What does sexual orientation orient? A biobehavioral model distinguishing romantic love and sexual desire. , 2003, Psychological review.

[21]  P. Rozin,et al.  High frequency of facial expressions corresponding to confusion, concentration, and worry in an analysis of naturally occurring facial expressions of Americans. , 2003, Emotion.

[22]  J. Russell.  Core affect and the psychological construction of emotion. , 2003, Psychological review.

[23]  J. Campos,et al.  The retention effects of an adult's emotional displays on infant behavior. , 2004, Child development.

[24]  Jessica L. Tracy,et al.  Show Your Pride , 2004, Psychological science.

[25]  P. Ekman,et al.  Personality Processes and Individual Differences the Relationship among Expressions, Labels, and Descriptions of Contempt , 2022 .

[26]  Belinda Campos,et al.  Romantic love and sexual desire in close relationships. , 2006, Emotion.

[27]  L. F. Barrett.  Are Emotions Natural Kinds? , 2006, Perspectives on psychological science : a journal of the Association for Psychological Science.

[28]  Hillary Anger Elfenbein,et al.  Toward a dialect theory: cultural differences in the expression and recognition of posed facial expressions. , 2007, Emotion.

[29]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[30]  Jessica L. Tracy,et al.  The spontaneous expression of pride and shame: Evidence for biologically innate nonverbal displays , 2008, Proceedings of the National Academy of Sciences.

[31]  Ran R. Hassin,et al.  Angry, Disgusted, or Afraid? , 2008, Psychological science.

[32]  Michael D. Robinson,et al.  Measures of emotion: A review , 2009, Cognition & emotion.

[33]  J. Russell.  Please Scroll down for Article Cognition & Emotion Emotion, Core Affect, and Psychological Construction , 2022 .

[34]  K. Scherer.  The dynamic architecture of emotion: Evidence for the component process model , 2009 .

[35]  Emiliana R. Simon-Thomas,et al.  Compassion: an evolutionary analysis and empirical review. , 2010, Psychological bulletin.

[36]  P. Ekman,et al.  What is Meant by Calling Emotions Basic , 2011 .

[37]  Heather C. Lench,et al.  Discrete emotions predict changes in cognition, judgment, experience, behavior, and physiology: a meta-analysis of experimental emotion elicitations. , 2011, Psychological bulletin.

[38]  Adrian P Burgess,et al.  A facial expression for anxiety. , 2012, Journal of personality and social psychology.

[39]  Dacher Keltner,et al.  Journal of Personality and Social Psychology Flustered and Faithful: Embarrassment as a Signal of Prosociality , 2011 .

[40]  Jessica L. Tracy,et al.  The Emotional Origins of a Social Learning Bias : Does the Pride Expression Cue Copying ? , 2012 .

[41]  Jari K. Hietanen,et al.  The Emergence and Stability of the Attentional Bias to Fearful Faces in Infancy , 2013 .

[42]  D. Keltner,et al.  What is shared, what is different? Core relational themes and expressive displays of eight positive emotions , 2013, Cognition & emotion.

[43]  T. Grossmann,et al.  Unconscious discrimination of social cues from eye whites in infants , 2014, Proceedings of the National Academy of Sciences.

[44]  S. Pinker,et al.  The Commitment Function of Angry Facial Expressions , 2014, Psychological science.

[45]  Josephine Sullivan,et al.  One millisecond face alignment with an ensemble of regression trees , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[46]  L. Brinke,et al.  Saving face? When emotion displays during public apologies mitigate damage to organizational performance , 2015 .

[47]  Rebecca Saxe,et al.  Neural Representations of Emotion Are Organized around Abstract Event Features , 2015, Current Biology.

[48]  Daniel T. Cordaro,et al.  Contentment: Perceived Completeness across Cultures and Traditions , 2016 .

[49]  Oliver G. B. Garrod,et al.  Four not six: Revealing culturally common facial expressions of emotion. , 2016, Journal of experimental psychology. General.

[50]  David Sander,et al.  Theoretical approaches to emotion and its measurement , 2021, Emotion Measurement.

[51]  Ronnie B. Wilbur,et al.  The not face: A grammaticalization of facial expressions of emotion , 2016, Cognition.

[52]  David Sander,et al.  Emotion perception from a componential perspective , 2017, Cognition & emotion.

[53]  Alan S. Cowen,et al.  Self-report captures 27 distinct categories of emotion bridged by continuous gradients , 2017, Proceedings of the National Academy of Sciences.

[54]  L. F. Barrett.  Categories and Their Role in the Science of Emotion , 2017, Psychological inquiry.

[55]  Emiliana R. Simon-Thomas,et al.  Beyond Happiness: Building a Science of Discrete Positive Emotions , 2017, The American psychologist.

[56]  R. Adolphs,et al.  Emotion Perception from Face, Voice, and Touch: Comparisons and Convergence , 2017, Trends in Cognitive Sciences.

[57]  Andrea Scarantino,et al.  How to Do Things with Emotional Expressions: The Theory of Affective Pragmatics , 2017 .

[58]  D. Matsumoto,et al.  Methodological Issues Regarding Cross-Cultural Studies of Judgments of Facial Expressions , 2017 .

[59]  J. Russell,et al.  The Emotion Seen in a Face Can Be a Methodological Artifact: The Process of Elimination Hypothesis , 2017, Emotion.

[60]  L. Camras,et al.  Infant Differential Behavioral Responding to Discrete Emotions , 2017, Emotion.

[61]  Hillary Anger Elfenbein,et al.  Mapping 24 emotions conveyed by brief human vocalization. , 2019, The American psychologist.

[62]  P. O’Higgins,et al.  Supraorbital morphology and social dynamics in human evolution , 2018, Nature Ecology & Evolution.

[63]  Dacher Keltner,et al.  Universals and Cultural Variations in 22 Emotional Expressions Across Five Cultures , 2018, Emotion.

[64]  Alan S. Cowen,et al.  Clarifying the Conceptualization, Dimensionality, and Structure of Emotion: Response to Barrett and Colleagues , 2018, Trends in Cognitive Sciences.

[65]  Alan S. Cowen,et al.  What Basic Emotion Theory Really Says for the Twenty-First Century Study of Emotion , 2019, Journal of Nonverbal Behavior.

[66]  Alan S. Cowen,et al.  Mapping the Passions: Toward a High-Dimensional Taxonomy of Emotional Experience and Expression , 2019, Psychological science in the public interest : a journal of the American Psychological Society.

[67]  L. Nummenmaa,et al.  Emotions as discrete patterns of systemic activity , 2017, Neuroscience Letters.

[68]  Alan S. Cowen,et al.  The recognition of 18 facial-bodily expressions across nine cultures. , 2020, Emotion.

[69]  Alan Cowen,et al.  Emotional Expression: Advances in Basic Emotion Theory , 2019, Journal of Nonverbal Behavior.

[70]  Hillary Anger Elfenbein,et al.  The primacy of categories in the recognition of 12 emotions in speech prosody across two cultures , 2019, Nature Human Behaviour.

[71]  Alan S. Cowen,et al.  UvA-DARE (Digital Academic Repository) What music makes us feel: At least 13 dimensions organize subjective experiences associated with music across different cultures , 2022 .

[72]  Alan S. Cowen,et al.  Reply to Bowling: How specific emotions are primary in subjective experience , 2020, Proceedings of the National Academy of Sciences.

[73]  Alan S. Cowen,et al.  The Neural Representation of Visually Evoked Emotion Is High-Dimensional, Categorical, and Distributed across Transmodal Brain Regions , 2020, iScience.