Emotion words: Facing change

Abstract We assessed the role that language plays in detecting a change in a transitioning emotional face. In two experiments, participants were presented with emotion or control words prior to seeing a transitioning face from one emotion to another (e.g., anger-disgust). In the first experiment, participants (n = 42) took less time to detect a change in a transitioning emotion face following a congruent emotion word (to the first face) compared to a control word. Participants also took more time to detect the same change following an incongruent emotion word (to the first face) compared to a control word. Our results suggest that depending on the relationship between the face and word, emotion words affect the point at which participants see the face as transitioning between emotional categories. In the second experiment (n = 39), we replicated the behavioral effects and calculated event-related potentials (ERPs), which were time-locked to the onset of the transitioning faces. We found that participants' N400 ERP responses appeared earlier following a congruent emotion word, providing additional neural evidence for emotion words impacting category distinctions of affective information. In a third experiment, we ruled out previous methodological concerns as well as showed that our effects are specific to emotion words and not more generalized emotion stimuli.

[1]  Zuzanna Skóra,et al.  The interplay of language and visual perception in working memory , 2017, Cognition.

[2]  Kristen A. Lindquist,et al.  When a Word Is Worth a Thousand Pictures: Language Shapes Perceptual Memory for Emotion , 2018, Journal of experimental psychology. General.

[3]  M. Shatz.  Language in Mind: Advances in the Study of Language and Thought (review) , 2006 .

[4]  M. Kutas,et al.  Reading senseless sentences: brain potentials reflect semantic incongruity. , 1980, Science.

[5]  Beatrice de Gelder,et al.  Context influences early perceptual analysis of faces--an electrophysiological study. , 2006, Cerebral cortex.

[6]  G. Lupyan.  The Label Feedback Hypothesis: Linguistic Influences on Visual Processing . , 2007 .

[7]  Sonja A. Kotz,et al.  Attentional orienting towards emotion: P2 and N400 ERP effects , 2011, Neuropsychologia.

[8]  J. Davidoff,et al.  The categorical perception of colors and facial expressions: The effect of verbal interference , 2000, Memory & cognition.

[9]  L. F. Barrett.  Are Emotions Natural Kinds? , 2006, Perspectives on psychological science : a journal of the Association for Psychological Science.

[10]  Geoffrey F. Woodman,et al.  A brief introduction to the use of event-related potentials in studies of perception and attention , 2010 .

[11]  Richard B. Ivry,et al.  The Influence of Language on Perception: Listening to Sentences about Faces Affects the Perception of Faces , 2010, The Journal of Neuroscience.

[12]  Kristen A. Lindquist,et al.  What’s in a Word? Language Constructs Emotion Perception , 2013 .

[13]  L. F. Barrett.  Solving the Emotion Paradox: Categorization and the Experience of Emotion , 2006, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[14]  M. Bar,et al.  Magnocellular Projections as the Trigger of Top-Down Facilitation in Recognition , 2007, The Journal of Neuroscience.

[15]  L. F. Barrett,et al.  Emotion Words: Adding Face Value , 2018, Emotion.

[16]  Ajay B. Satpute,et al.  Does Language Do More Than Communicate Emotion? , 2015, Current directions in psychological science.

[17]  J. Russell,et al.  A Label Superiority Effect in Children's Categorization of Facial Expressions , 2002 .

[18]  J. Lupiáñez,et al.  High density ERP indices of conscious and unconscious semantic priming. , 2003, Brain research. Cognitive brain research.

[19]  Kara D. Federmeier,et al.  Chapter 1 Time for Meaning: Electrophysiology Provides Insights into the Dynamics of Representation and Processing in Semantic Memory , 2009 .

[20]  Introduction: Linguistic relativity re-examined , 1996 .

[21]  H. Jasper,et al.  The ten-twenty electrode system of the International Federation. The International Federation of Clinical Neurophysiology. , 1999, Electroencephalography and clinical neurophysiology. Supplement.

[22]  L. F. Barrett.  The theory of constructed emotion: an active inference account of interoception and categorization , 2016, Social cognitive and affective neuroscience.

[23]  L. F. Barrett,et al.  The Role of Language on the Perception and Experience of Emotion , 2014 .

[24]  Linda B. Smith,et al.  Linguistic Cues Enhance the Learning of Perceptual Cues , 2005, Psychological science.

[25]  Kara D. Federmeier,et al.  Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). , 2011, Annual review of psychology.

[26]  Greg Hajcak,et al.  Previously reappraised: the lasting effect of description type on picture-elicited electrocortical activity. , 2011, Social cognitive and affective neuroscience.

[27]  D. Roberson,et al.  Categorical perception effects reflect differences in typicality on within-category trials , 2011, Psychonomic bulletin & review.

[28]  Michiel Wiggers,et al.  Judgments of facial expressions of emotion predicted from facial behavior , 1982 .

[29]  Stefan R. Schweinberger,et al.  Covert Recognition and the Neural System for Face Processing , 2003, Cortex.

[30]  Clinton D. Kilts,et al.  Dissociable Neural Pathways Are Involved in the Recognition of Emotion in Static and Dynamic Facial Expressions , 2003, NeuroImage.

[31]  Sandra R. Waxman,et al.  Words as Invitations to Form Categories: Evidence from 12- to 13-Month-Old Infants , 1995, Cognitive Psychology.

[32]  Gary Lupyan,et al.  Language can boost otherwise unseen objects into visual awareness , 2013, Proceedings of the National Academy of Sciences.

[33]  J. Kissler,et al.  Something always sticks? how emotional language modulates neural processes involved in face encoding and recognition memory , 2017 .

[34]  Lisa Feldman Barrett,et al.  Emotion Words Shape Emotion Percepts , 2022 .

[35]  Matthias J. Wieser,et al.  Not so harmless anymore: How context impacts the perception and electrocortical processing of neutral faces , 2014, NeuroImage.

[36]  Elizabeth S Spelke,et al.  Language and number: a bilingual training study , 2001, Cognition.

[37]  A. Young,et al.  Priming of Emotion Recognition , 2005, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[38]  G. Lupyan.  Linguistically Modulated Perception and Cognition: The Label-Feedback Hypothesis , 2012, Front. Psychology.

[39]  Kristen A. Lindquist,et al.  Language and the perception of emotion. , 2006, Emotion.

[40]  G. Lupyan,et al.  Words Jump-Start Vision: A Label Advantage in Object Recognition , 2015, The Journal of Neuroscience.

[41]  S. Thompson-Schill,et al.  The evocative power of words: activation of concepts by verbal and nonverbal means. , 2012, Journal of experimental psychology. General.

[42]  Kristen A. Lindquist,et al.  Opinion TRENDS in Cognitive Sciences Vol.11 No.8 Cognitive-emotional interactions Language as context for the , 2022 .

[43]  Piotr Winkielman,et al.  Emotional Conception , 2009, Psychological science.

[44]  P. Niedenthal,et al.  Effects of emotion concepts on perceptual memory for emotional expressions. , 2001, Journal of personality and social psychology.

[45]  John J. Magee,et al.  Categorical perception of facial expressions , 1992, Cognition.

[46]  A. Clark.  Whatever next? Predictive brains, situated agents, and the future of cognitive science. , 2013, The Behavioral and brain sciences.

[47]  L. F. Barrett,et al.  Reading chimpanzee faces: evidence for the role of verbal labels in categorical perception of emotion. , 2010, Emotion.

[48]  Dan Foti,et al.  Tell me about it: neural activity elicited by emotional pictures and preceding descriptions. , 2009, Emotion.

[49]  Brian T. Gold,et al.  Neural correlates of cross-domain affective priming , 2010, Brain Research.

[50]  M. Bar.  A Cortical Mechanism for Triggering Top-Down Facilitation in Visual Object Recognition , 2003, Journal of Cognitive Neuroscience.

[51]  G. Lupyan.  The conceptual grouping effect: Categories matter (and named categories matter more) , 2008, Cognition.

[52]  A. Clark,et al.  Words and the World , 2015 .

[53]  Margot J. Taylor,et al.  Guidelines for using human event-related potentials to study cognition: recording standards and publication criteria. , 2000, Psychophysiology.

[54]  G. Woodman.  A brief introduction to the use of event-related potentials in studies of perception and attention. , 2010, Attention, perception & psychophysics.

[55]  Robert L. Goldstone.  Influences of categorization on perceptual discrimination. , 1994, Journal of experimental psychology. General.

[56]  E. Naito,et al.  Enhanced neural activity in response to dynamic facial expressions of emotion: an fMRI study. , 2004, Brain research. Cognitive brain research.

[57]  P. Salovey,et al.  Emotional Intelligence , 1990, Encyclopedia of Personality and Individual Differences.

[58]  L. F. Barrett.  How Emotions Are Made: The Secret Life of the Brain , 2017 .

[59]  Janneke F. M. Jehee,et al.  Less Is More: Expectation Sharpens Representations in the Primary Visual Cortex , 2012, Neuron.

[60]  Markus Junghöfer,et al.  An evil face? Verbal evaluative multi-CS conditioning enhances face-evoked mid-latency magnetoencephalographic responses , 2016, Social cognitive and affective neuroscience.

[61]  T. Ito,et al.  Tracking the dynamics of the social brain: ERP approaches for social cognitive and affective neuroscience. , 2014, Social cognitive and affective neuroscience.

[62]  Atsushi Matsumoto,et al.  Linking semantic priming effect in functional MRI and event-related potentials , 2005, NeuroImage.

[63]  Jennifer M. B. Fugate.  Categorical Perception for Emotional Faces , 2013, Emotion review : journal of the International Society for Research on Emotion.