Switching Between Sensory and Affective Systems Incurs Processing Costs

Recent models of the conceptual system hold that concepts are grounded in simulations of actual experiences with instances of those concepts in sensory-motor systems (e.g., Barsalou, 1999, 2003; Solomon & Barsalou, 2001). Studies supportive of such a viewhave shown that verifying a property of a concept in one modality, and then switching to verify a property of a different concept in a different modality generates temporal processing costs similar to the cost of switching modalities in perception. In addition to non-emotional concepts, the present experiment investigated switching costs in verifying properties of positive and negative (emotional) concepts. Properties of emotional concepts were taken from vision, audition, and the affective system. Parallel to switching costs in neutral concepts, the study showed that for positive and negative concepts, verifying properties from different modalities produced processing costs such that reaction times were longer and error rates were higher. Importantly, this effect was observed when switching from the affective system to sensory modalities, and vice-versa. These results support the embodied cognition view of emotion in humans.

[1]  A. Ohman,et al.  The face in the crowd revisited: a threat advantage with schematic stimuli. , 2001, Journal of personality and social psychology.

[2]  Jan De Houwer,et al.  A time course analysis of the affective priming effect , 2001 .

[3]  A. Glenberg,et al.  What memory is for: Creating meaning in the service of action , 1997, Behavioral and Brain Sciences.

[4]  P. Niedenthal,et al.  When did her smile drop? Facial mimicry and the influences of emotional state on the detection of change in emotional expression , 2001 .

[5]  J. Morais,et al.  Valeur affective de 904 mots de la langue française , 1989 .

[6]  J. Gore,et al.  Activation of the left amygdala to a cognitive representation of fear , 2001, Nature Neuroscience.

[7]  M I Posner,et al.  Cognitive neuroscience: origins and promise. , 2000, Psychological bulletin.

[8]  R. Adolphs,et al.  A Role for Somatosensory Cortices in the Visual Recognition of Emotion as Revealed by Three-Dimensional Lesion Mapping , 2000, The Journal of Neuroscience.

[9]  Michael P. Kaschak,et al.  Grounding language in action , 2002, Psychonomic bulletin & review.

[10]  Irene P. Kan,et al.  ROLE OF MENTAL IMAGERY IN A PROPERTY VERIFICATION TASK: FMRI EVIDENCE FOR PERCEPTUAL REPRESENTATIONS OF CONCEPTUAL KNOWLEDGE , 2003, Cognitive neuropsychology.

[11]  L. Barsalou,et al.  Embodiment in Attitudes, Social Perception, and Emotion , 2005, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[12]  L. Barsalou,et al.  Embodiment in the acquisition and use of emotion knowledge , 2005 .

[13]  Daniel Tranel,et al.  Amygdala damage impairs emotion recognition from scenes only when they contain facial expressions , 2003, Neuropsychologia.

[14]  Patrick Bonin,et al.  A prototype analysis of the French category “émotion” , 2004 .

[15]  Lawrence W. Barsalou,et al.  Representing Properties Locally , 2001, Cognitive Psychology.

[16]  Effects of instruction on acquisition and extinction of electrodermal responses to fear-relevant stimuli. , 1977, Journal of experimental psychology. Human learning and memory.

[17]  G. Rizzolatti,et al.  Both of Us Disgusted in My Insula The Common Neural Basis of Seeing and Feeling Disgust , 2003, Neuron.

[18]  Paula M. Niedenthal,et al.  Being happy and seeing "happy": Emotional state mediates visual word recognition. , 1997 .

[19]  W. K. Simmons,et al.  Pictures of appetizing foods activate gustatory cortices for taste and reward. , 2005, Cerebral cortex.

[20]  Arielle Syssau,et al.  Évaluations des caractéristiques émotionnelles d'un corpus de 604 mots , 2005 .

[21]  Lawrence W Barsalou,et al.  Abstraction in perceptual symbol systems. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[22]  Diane Pecher,et al.  Sensorimotor simulations underlie conceptual representations: Modality-specific effects of prior activation , 2004, Psychonomic bulletin & review.

[23]  Roger Ratcliff,et al.  Methods for Dealing With Reaction Time Outliers , 1992 .

[24]  A. Ohman,et al.  Effects of instruction on acquisition and extinction of electrodermal responses to fear-relevant stimuli. , 1977, Journal of experimental psychology. Human learning and memory.

[25]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[26]  R. Adolphs,et al.  Cortical Systems for the Recognition of Emotion in Facial Expressions , 1996, The Journal of Neuroscience.

[27]  F. Strack,et al.  Approach and avoidance: the influence of proprioceptive and exteroceptive cues on encoding of affective information. , 2000, Journal of personality and social psychology.

[28]  L. Barsalou,et al.  Verifying Different-Modality Properties for Concepts Produces Switching Costs , 2003, Psychological science.

[29]  J. Decety,et al.  The functional architecture of human empathy. , 2004, Behavioral and cognitive neuroscience reviews.

[30]  V. Gallese The Roots of Empathy: The Shared Manifold Hypothesis and the Neural Basis of Intersubjectivity , 2003, Psychopathology.

[31]  C. Spence,et al.  The cost of expecting events in the wrong sensory modality , 2001, Perception & psychophysics.

[32]  Andreas Olsson,et al.  Learned Fear of “Unseen” Faces after Pavlovian, Observational, and Instructed Fear , 2004, Psychological science.