The perception and categorisation of emotional stimuli: A review

When we perceive our environment, we rapidly integrate large amounts of incoming stimulus information into categories that help to guide our understanding of the world. Some stimuli are more relevant for our well-being and survival than others, for example stimuli that signal a threat or an opportunity for growth and expansion. In this review we examine the special role of such “emotional” stimuli in perception and categorisation. To this end, we first discuss some fundamental aspects of perception, with an emphasis on the cognitive process of categorisation. We then tackle the questions: “What is an emotional stimulus?” and “What is an emotion category?” Afterwards, we illustrate, with a review of key findings from the empirical literature, (i) how stimuli are categorised as emotional, and (ii) how the perceptual processing of emotional stimuli is prioritised to allow for a rapid preparation of adaptive responses. To conclude, we discuss how research on the perception of emotional stimuli can contribute to current debates in psychology, namely (i) about the role of bottom-up vs. top-down factors in emotional processing and experience, and (ii) about the nature of the relationship between cognition and emotion.

[1]  M. Guha The Oxford Companion to Emotion and the Affective Sciences , 2010 .

[2]  A. Moors Automatic Constructive Appraisal as a Candidate Cause of Emotion , 2010 .

[3]  Robert L. Goldstone,et al.  Categorical perception. , 2010, Wiley interdisciplinary reviews. Cognitive science.

[4]  K. Scherer The dynamic architecture of emotion: Evidence for the component process model , 2009 .

[5]  Robin S. Edelstein,et al.  Emotion and memory narrowing: A review and goal-relevance approach , 2009 .

[6]  A. Moors Theories of emotion causation: A review , 2009 .

[7]  Kimron Shapiro,et al.  Attentional blink , 2009, Scholarpedia.

[8]  A. Ohman,et al.  Recognizing masked threat: fear betrays, but disgust you can trust. , 2008, Emotion.

[9]  A. Herbert,et al.  The face wins: Stronger automatic processing of affect in facial expressions than words in a modified Stroop task , 2008 .

[10]  Daniel Smilek,et al.  Visual search for faces with emotional expressions. , 2008, Psychological bulletin.

[11]  Roman Feiman,et al.  Expressing fear enhances sensory acquisition , 2008, Nature Neuroscience.

[12]  J. Panksepp Cognitive Conceptualism—Where Have All the Affects Gone? Additional Corrections for Barrett et al. (2007) , 2008, Perspectives on psychological science : a journal of the Association for Psychological Science.

[13]  Klaus R. Scherer,et al.  Facial expressions allow inference of both emotions and their components , 2008 .

[14]  Tobias Brosch,et al.  Beyond Fear , 2008, Psychological science.

[15]  E. Phelps,et al.  How (and Why) Emotion Enhances the Subjective Sense of Recollection , 2008, Current directions in psychological science.

[16]  David Sander,et al.  Basic tastes and basic emotions: Basic problems and perspectives for a nonbasic solution , 2008 .

[17]  L. Pessoa On the relationship between emotion and cognition , 2008, Nature Reviews Neuroscience.

[18]  E. Fox,et al.  The detection of fear-relevant stimuli: are guns noticed as quickly as snakes? , 2007, Emotion.

[19]  Gernot Horstmann,et al.  Preattentive face processing: What do visual search experiments with schematic faces tell us? , 2007 .

[20]  J. Panksepp Neurologizing the Psychology of Affects: How Appraisal-Based Constructivism and Basic Emotion Theory Can Coexist , 2007, Perspectives on psychological science : a journal of the Association for Psychological Science.

[21]  C. Izard Basic Emotions, Natural Kinds, Emotion Schemas, and a New Paradigm , 2007, Perspectives on psychological science : a journal of the Association for Psychological Science.

[22]  Kristen A. Lindquist,et al.  Of Mice and Men: Natural Kinds of Emotions in the Mammalian Brain? A Response to Panksepp and Izard , 2007, Perspectives on psychological science : a journal of the Association for Psychological Science.

[23]  A. Moors Can cognitive methods be used to study the unique aspect of emotion: An appraisal theorist's answer , 2007 .

[24]  L. F. Barrett,et al.  Affect is a form of cognition: A neurobiological analysis , 2007, Cognition & emotion.

[25]  B. Hommel,et al.  COGNITION AND EMOTION , 2007 .

[26]  Tobias Brosch,et al.  That baby caught my eye... attention capture by infant faces. , 2007, Emotion.

[27]  Kristen A. Lindquist,et al.  Opinion TRENDS in Cognitive Sciences Vol.11 No.8 Cognitive-emotional interactions Language as context for the , 2022 .

[28]  Stephen D. Smith,et al.  The naked truth: Positive, arousing distractors impair rapid target perception , 2007 .

[29]  M. Bar The proactive brain: using analogies and associations to generate predictions , 2007, Trends in Cognitive Sciences.

[30]  K. Scherer,et al.  Interaction effects of perceived gaze direction and dynamic facial expression: Evidence for appraisal theories of emotion , 2007 .

[31]  O. Lipp,et al.  Automatic attention does not equal automatic fear: preferential attention without implicit valence. , 2007, Emotion.

[32]  Emily Balcetis,et al.  See what you want to see: motivational influences on visual perception. , 2006, Journal of personality and social psychology.

[33]  Kyle R. Cave,et al.  From searching for features to searching for threat: Drawing the boundary between preattentive and attentive vision , 2006 .

[34]  L. Damjanovic,et al.  The eyes are sufficient to produce a threat superiority effect. , 2006, Emotion.

[35]  I. Blanchette Snakes, spiders, guns, and syringes: How specific are evolutionary constraints on the detection of threatening stimuli? , 2006, Quarterly journal of experimental psychology.

[36]  G. Horstmann,et al.  Search asymmetries with real faces: testing the anger-superiority effect. , 2006, Emotion.

[37]  René Zeelenberg,et al.  The Impact of Emotion on Perception , 2006, Psychological science.

[38]  J. DiCarlo,et al.  Learning and neural plasticity in visual object recognition , 2006, Current Opinion in Neurobiology.

[39]  L. F. Barrett Are Emotions Natural Kinds? , 2006, Perspectives on psychological science : a journal of the Association for Psychological Science.

[40]  Michael D. Robinson,et al.  Semantic Processing Precedes Affect Retrieval: The Neurological Case for Cognitive Primacy in Visual Processing , 2006 .

[41]  B. Gelder Towards the neurobiology of emotional body language , 2006, Nature Reviews Neuroscience.

[42]  L. F. Barrett Solving the Emotion Paradox: Categorization and the Experience of Emotion , 2006, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[43]  R. Cabeza,et al.  Cognitive neuroscience of emotional memory , 2006, Nature Reviews Neuroscience.

[44]  E. Phelps Emotion and cognition: insights from studies of the human amygdala. , 2006, Annual review of psychology.

[45]  Daniel Lundqvist,et al.  Looking for foes and friends: perceptual and emotional factors when finding a face in the crowd. , 2005, Emotion.

[46]  P. Vuilleumier,et al.  How brains beware: neural mechanisms of emotional attention , 2005, Trends in Cognitive Sciences.

[47]  Petri Laukka,et al.  Categorical perception of vocal emotion expressions. , 2005, Emotion.

[48]  A. Flykt,et al.  Visual search with biological threat stimuli: accuracy, reaction times, and heart rate changes. , 2005, Emotion.

[49]  T. Brosch,et al.  The role of fear-relevant stimuli in visual search: a comparison of phylogenetic and ontogenetic stimuli. , 2005, Emotion.

[50]  A. Anderson Affective influences on the attentional dynamics supporting awareness. , 2005, Journal of experimental psychology. General.

[51]  Garrison W. Cottrell,et al.  Transmitting and Decoding Facial Expressions , 2005, Psychological science.

[52]  J. Mattingley,et al.  Look at me, I'm smiling: Visual search for threatening and nonthreatening facial expressions , 2005 .

[53]  Kent C. Berridge,et al.  Unconscious Affective Reactions to Masked Happy Versus Angry Faces Influence Consumption Behavior and Judgments of Value , 2005, Personality & social psychology bulletin.

[54]  James S. Boster,et al.  Emotion Categories Across Languages , 2005 .

[55]  S. Harnad To Cognize is to Categorize: Cognition is Categorization , 2005 .

[56]  Andrew L. Alexander,et al.  Contextual Modulation of Amygdala Responsivity to Surprised Faces , 2004, Journal of Cognitive Neuroscience.

[57]  G. Crombez,et al.  Does imminent threat capture and hold attention? , 2004, Emotion.

[58]  C. Snider,et al.  The Eyes , 1877, Canadian Medical Association Journal.

[59]  M. Bar Visual objects in context , 2004, Nature Reviews Neuroscience.

[60]  J. Wolfe,et al.  What attributes guide the deployment of visual attention and how do they do it? , 2004, Nature Reviews Neuroscience.

[61]  A. Young,et al.  Emotion Perception from Dynamic and Static Body Expressions in Point-Light and Full-Light Displays , 2004, Perception.

[62]  I. Gauthier,et al.  Visual object understanding , 2004, Nature Reviews Neuroscience.

[63]  A. Keil,et al.  Identification facilitation for emotionally arousing verbs during the attentional blink. , 2004, Emotion.

[64]  Tom Johnstone,et al.  Inverse amygdala and medial prefrontal cortex responses to surprised faces , 2003, Neuroreport.

[65]  R. Kleck,et al.  Perceived Gaze Direction and the Processing of Facial Displays of Emotion , 2003, Psychological science.

[66]  P. Laukka,et al.  Communication of emotions in vocal expression and music performance: different channels, same code? , 2003, Psychological bulletin.

[67]  K. Scherer,et al.  Appraisal processes in emotion. , 2003 .

[68]  J. Grafman,et al.  The Human Amygdala: An Evolved System for Relevance Detection , 2003, Reviews in the neurosciences.

[69]  K. Scherer,et al.  Handbook of affective sciences. , 2003 .

[70]  J. Russell Core affect and the psychological construction of emotion. , 2003, Psychological review.

[71]  Gernot Horstmann,et al.  Facial expressions of emotion: does the prototype represent central tendency, frequency of instantiation, or an ideal? , 2002, Emotion.

[72]  Philip Quinlan,et al.  Searching for threat , 2002, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[73]  E. Fox,et al.  Attentional bias for threat: Evidence for delayed disengagement from emotional faces , 2002, Cognition & emotion.

[74]  Hillary Anger Elfenbein,et al.  On the universality and cultural specificity of emotion recognition: a meta-analysis. , 2002, Psychological bulletin.

[75]  P. Matthews,et al.  Exacerbation of Pain by Anxiety Is Associated with Activity in a Hippocampal Network , 2001, The Journal of Neuroscience.

[76]  P. Niedenthal,et al.  Effects of emotion concepts on perceptual memory for emotional expressions. , 2001, Journal of personality and social psychology.

[77]  A. Ohman,et al.  Emotion drives attention: detecting the snake in the grass. , 2001, Journal of experimental psychology. General.

[78]  Jules Davidoff,et al.  Language and perceptual categorisation , 2001, Trends in Cognitive Sciences.

[79]  J. Eastwood,et al.  Differential attentional guidance by unattended faces expressing positive and negative emotion , 2001, Perception & psychophysics.

[80]  A. Anderson,et al.  Lesions of the human amygdala impair enhanced perception of emotionally salient events , 2001, Nature.

[81]  A. Ohman,et al.  The face in the crowd revisited: a threat advantage with schematic stimuli. , 2001, Journal of personality and social psychology.

[82]  S. Mineka,et al.  Fears, phobias, and preparedness: toward an evolved module of fear and fear learning. , 2001, Psychological review.

[83]  K. Scherer Appraisal considered as a process of multilevel sequential checking. , 2001 .

[84]  K. Scherer,et al.  Appraisal processes in emotion: Theory, methods, research. , 2001 .

[85]  J. Davidoff,et al.  Color categories are not universal: replications and new evidence from a stone-age culture. , 2000, Journal of experimental psychology. General.

[86]  David Sheffield,et al.  Race and Sex Differences in Cutaneous Pain Perception , 2000, Psychosomatic medicine.

[87]  L. Obler,et al.  Relationships among Facial, Prosodic, and Lexical Channels of Emotional Perceptual Processing , 2000 .

[88]  Z. Pylyshyn Is vision continuous with cognition? The case for cognitive impenetrability of visual perception. , 1999, The Behavioral and brain sciences.

[89]  Åse Innes-Ker,et al.  Emotional response categorization. , 1999 .

[90]  Scott T. Grafton,et al.  Amygdala activity related to enhanced memory for pleasant and aversive stimuli , 1999, Nature Neuroscience.

[91]  R. Davidson,et al.  The functional neuroanatomy of emotion and affective style , 1999, Trends in Cognitive Sciences.

[92]  Pierre Philippot,et al.  Facial Reactions to Emotional Facial Expressions: Affect or Cognition? , 1998 .

[93]  Nirbhay N. Singh,et al.  Facial Expressions of Emotion , 1998 .

[94]  J. Panksepp Affective Neuroscience: The Foundations of Human and Animal Emotions , 1998 .

[95]  M. Daneman,et al.  PSYCHOLOGICAL INVESTIGATIONS OF UNCONSCIOUS PERCEPTION , 1998 .

[96]  D. Perrett,et al.  Facial expression megamix: Tests of dimensional and category accounts of emotion recognition , 1997, Cognition.

[97]  B. L. Whorf The Relation of Habitual Thought and Behavior to Language , 1997 .

[98]  J. Russell The psychology of facial expression: Reading emotions from and into faces: Resurrecting a dimensional-contextual perspective , 1997 .

[99]  J. M. Carroll,et al.  Facial Expressions in Hollywood's Portrayal of Emotion , 1997 .

[100]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[101]  D. Perrett,et al.  Categorical Perception of Morphed Facial Expressions , 1996 .

[102]  I. Walker,et al.  Social Cognition: An Integrated Introduction , 1996 .

[103]  J. M. Carroll,et al.  Do facial expressions signal specific emotions? Judging emotion from the face in context. , 1996, Journal of personality and social psychology.

[104]  F. Keil,et al.  Categorical effects in the perception of faces , 1995, Cognition.

[105]  J. Russell Facial expressions of emotion: what lies beyond minimal universality? , 1995, Psychological bulletin.

[106]  P. Lang The emotion probe. Studies of motivation and attention. , 1995, The American psychologist.

[107]  P. Ekman,et al.  Strong evidence for universals in facial expressions: a reply to Russell's mistaken critique. , 1994, Psychological bulletin.

[108]  C. Izard Innate and universal facial expressions: evidence from developmental and cross-cultural research. , 1994, Psychological bulletin.

[109]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[110]  Jan De Houwer,et al.  Differences in the affective processing of words and pictures , 1994 .

[111]  J. Russell Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies. , 1994, Psychological bulletin.

[112]  H. Wallbott,et al.  Decoders' processing of emotional facial expression — a top-down or bottom-up mechanism?† , 1993 .

[113]  D. Cicchetti Emotion and Adaptation , 1993 .

[114]  J. Schulkin,et al.  What sort of system could an affective system be? A reply to LeDoux , 1993 .

[115]  John J. Magee,et al.  Categorical perception of facial expressions , 1992, Cognition.

[116]  W. Glaser Picture naming , 1992, Cognition.

[117]  S. Yantis Multielement visual tracking: Attention and perceptual organization , 1992, Cognitive Psychology.

[118]  P. Ekman An argument for basic emotions , 1992 .

[119]  Klaus R. Scherer,et al.  What does facial expression express , 1992 .

[120]  K L Shapiro,et al.  Temporary suppression of visual processing in an RSVP task: an attentional blink? . , 1992, Journal of experimental psychology. Human perception and performance.

[121]  J. Russell Culture and the categorization of emotions. , 1991, Psychological bulletin.

[122]  R. Lazarus Emotion and Adaptation , 1991 .

[123]  S. Yantis,et al.  Mechanisms of attentional priority. , 1990, Journal of experimental psychology. Human perception and performance.

[124]  S. Harnad Categorical Perception: The Groundwork of Cognition , 1990 .

[125]  J. Aronoff,et al.  The recognition of threatening facial stimuli. , 1988, Journal of personality and social psychology.

[126]  C. H. Hansen,et al.  Finding the face in the crowd: an anger superiority effect. , 1988, Journal of personality and social psychology.

[127]  N. Frijda The laws of emotion. , 1988, The American psychologist.

[128]  A Treisman,et al.  Feature analysis in early vision: evidence from search asymmetries. , 1988, Psychological review.

[129]  J. Russell,et al.  Relativity in the Perception of Emotion in Facial Expressions , 1987 .

[130]  P. Shaver,et al.  Emotion knowledge: further exploration of a prototype approach. , 1987, Journal of personality and social psychology.

[131]  K. Scherer,et al.  The Relationship of Emotion to Cognition: A Functional Approach to a Semantic Controversy , 1987 .

[132]  L. Barsalou Ideals, central tendency, and frequency of instantiation as determinants of graded structure in categories. , 1985, Journal of experimental psychology. Learning, memory, and cognition.

[133]  Bruce Bowe The Face of Emotion , 1985 .

[134]  D. Medin,et al.  The role of theories in conceptual coherence. , 1985, Psychological review.

[135]  James L. McClelland,et al.  Distributed memory and the representation of general and specific information. , 1985, Journal of experimental psychology. General.

[136]  Richard S. Lazarus,et al.  On the Primacy of Cognition. , 1984 .

[137]  M. Bornstein,et al.  Discrimination and matching within and between hues measured by reaction times: some implications for categorical perception and levels of information processing , 1984, Psychological research.

[138]  L. Barsalou,et al.  Ad hoc categories , 1983, Memory & cognition.

[139]  E. Hilgard The trilogy of mind: cognition, affection, and conation. , 1980, Journal of the history of the behavioral sciences.

[140]  R. Zajonc Feeling and thinking : Preferences need no inferences , 1980 .

[141]  P. Ekman,et al.  Facial Expressions of Emotion , 1979 .

[142]  Eleanor Rosch,et al.  Principles of Categorization , 1978 .

[143]  Wayne D. Gray,et al.  Basic objects in natural categories , 1976, Cognitive Psychology.

[144]  E. Rosch Cognitive Representations of Semantic Categories. , 1975 .

[145]  P. Ekman Unmasking The Face , 1975 .

[146]  E. R. Heider Universals in color naming and memory. , 1972, Journal of experimental psychology.

[147]  P. Ekman Universals and cultural differences in facial expressions of emotion. , 1972 .

[148]  P. Kay,et al.  Basic Color Terms: Their Universality and Evolution , 1973 .

[149]  B. C. Griffith,et al.  The discrimination of speech sounds within and across phoneme boundaries. , 1957, Journal of experimental psychology.

[150]  G. Arthur Race and sex differences. , 1933 .