Vocal emotions influence verbal memory: Neural correlates and interindividual differences

Past research has identified an event-related potential (ERP) marker for vocal emotional encoding and has highlighted vocal-processing differences between male and female listeners. We further investigated this ERP vocal-encoding effect in order to determine whether it predicts voice-related changes in listeners’ memory for verbal interaction content. Additionally, we explored whether sex differences in vocal processing would affect such changes. To these ends, we presented participants with a series of neutral words spoken with a neutral or a sad voice. The participants subsequently encountered these words, together with new words, in a visual word recognition test. In addition to making old/new decisions, the participants rated the emotional valence of each test word. During the encoding of spoken words, sad voices elicited a greater P200 in the ERP than did neutral voices. While the P200 effect was unrelated to a subsequent recognition advantage for test words previously heard with a neutral as compared to a sad voice, the P200 did significantly predict differences between these words in a concurrent late positive ERP component. Additionally, the P200 effect predicted voice-related changes in word valence. As compared to words studied with a neutral voice, words studied with a sad voice were rated more negatively, and this rating difference was larger, the larger the P200 encoding effect was. While some of these results were comparable in male and female participants, the latter group showed a stronger P200 encoding effect and qualitatively different ERP responses during word retrieval. Estrogen measurements suggested the possibility that these sex differences have a genetic basis.

[1]  Angela D. Friederici,et al.  When vocal processing gets emotional: On the role of social orientation in relevance detection by the human amygdala , 2008, NeuroImage.

[2]  Angela D. Friederici,et al.  Sex differences in the preattentive processing of vocal emotional expressions , 2005, Neuroreport.

[3]  S. Baldassi,et al.  Fearful expressions enhance recognition memory: electrophysiological evidence. , 2012, Acta psychologica.

[4]  M. Sarlo,et al.  When Faces Signal Danger: Event-Related Potentials to Emotional Facial Expressions in Animal Phobics , 2010, Neuropsychobiology.

[5]  A. Friederici,et al.  Sex differentiates the role of emotional prosody during word processing. , 2002, Brain research. Cognitive brain research.

[6]  Annett Schirmer,et al.  Listen up! Processing of intensity change differs for vocal and nonvocal sounds , 2007, Brain Research.

[7]  Kara D. Federmeier,et al.  Event-related brain potentials. , 1990 .

[8]  Annett Schirmer,et al.  What grabs his attention but not hers? Estrogen correlates with neurophysiological measures of vocal change detection , 2008, Psychoneuroendocrinology.

[9]  Jessica D. Payne,et al.  Impact of individual differences upon emotion-induced memory trade-offs , 2010, Cognition & emotion.

[10]  Shuo Wang,et al.  Squeeze me, but don't tease me: Human and mechanical touch enhance visual attention and emotion discrimination , 2011, Social neuroscience.

[11]  Lonce L. Wyse,et al.  Perceptual and Conceptual Priming of Environmental Sounds , 2011, Journal of Cognitive Neuroscience.

[12]  M. Eimer,et al.  Event-related brain potential correlates of emotional face processing , 2007, Neuropsychologia.

[13]  James L. McGaugh,et al.  β-Adrenergic activation and memory for emotional events , 1994, Nature.

[14]  R. Cabeza,et al.  Remembering one year later: role of the amygdala and the medial temporal lobe memory system in retrieving emotional memories. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[15]  I. Wambacq,et al.  Non-voluntary and voluntary processing of emotional prosody: an event-related potentials study , 2004, Neuroreport.

[16]  Matthias Gamer,et al.  Oxytocin increases amygdala reactivity to threatening scenes in females , 2012, Psychoneuroendocrinology.

[17]  G. Thierry,et al.  Event-related potential study of attention capture by affective sounds , 2007, Neuroreport.

[18]  Tali Sharot,et al.  How personal experience modulates the neural circuitry of memories of September 11 , 2007, Proceedings of the National Academy of Sciences.

[19]  Nick Medford,et al.  Emotional memory for words: Separating content and context , 2007 .

[20]  S. Kotz,et al.  ERP Evidence for a Sex-Specific Stroop Effect in Emotional Speech , 2003, Journal of Cognitive Neuroscience.

[21]  Brigitte Rockstroh,et al.  Processing of emotional adjectives: Evidence from startle EMG and ERPs. , 2006, Psychophysiology.

[22]  J. Kissler,et al.  Emotion and attention in visual word processing—An ERP study , 2009, Biological Psychology.

[23]  E Donchin,et al.  On how P300 amplitude varies with the utility of the eliciting stimuli. , 1978, Electroencephalography and clinical neurophysiology.

[24]  Elizabeth A. Kensinger,et al.  Memory enhancement for emotional words: Are emotional words more vividly remembered than neutral words? , 2003, Memory & cognition.

[25]  Annett Schirmer,et al.  Mark My Words: Tone of Voice Changes Affective Word Representations in Memory , 2010, PloS one.

[26]  Turhan Canli,et al.  Individual differences in emotion processing , 2004, Current Opinion in Neurobiology.

[27]  J. Kissler,et al.  Event related potentials to emotional adjectives during reading. , 2008, Psychophysiology.

[28]  S. Kitayama Remembrance of Emotional Speech: Improvement and Impairment of Incidental Verbal Memory by Emotional Voice , 1996 .

[29]  Stefan Zysset,et al.  Gender differences in the activation of inferior frontal cortex during emotional speech perception , 2004, NeuroImage.

[30]  Sonja A. Kotz,et al.  Early emotional prosody perception based on different speaker voices , 2008, Neuroreport.

[31]  R. Henson,et al.  Neural activity associated with episodic memory for emotional context , 2001, Neuropsychologia.

[32]  Gilles Pourtois,et al.  Fear recognition in the voice is modulated by unconsciously recognized facial expressions but not by unconsciously recognized affective pictures , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[33]  Sebastian Seifert,et al.  Orbito-frontal lesions cause impairment during late but not early emotional prosodic processing , 2010, Social neuroscience.

[34]  M. Yücel,et al.  Sex differences in the neural correlates of emotion: Evidence from neuroimaging , 2011, Biological Psychology.

[35]  Michael J Meaney,et al.  Epigenetics and the environmental regulation of the genome and its function. , 2010, Annual review of psychology.

[36]  P. Hagoort,et al.  Empathy matters: ERP evidence for inter-individual differences in social language processing , 2010, Social cognitive and affective neuroscience.

[37]  Olivier Piguet,et al.  Memory for contextual details: effects of emotion and aging. , 2005, Psychology and aging.

[38]  M. Van der Linden,et al.  Influence of facial expression on memory for facial identity: effects of visual features or emotional meaning? , 2011, Emotion.

[39]  Marta Kutas,et al.  Electrophysiological Correlates of Emotion-Induced Recognition Bias , 2001, Journal of Cognitive Neuroscience.

[40]  Vicka R. Corey,et al.  On the Language Specificity of the Brain Response to Syntactic Anomalies: Is the Syntactic Positive Shift a Member of the P300 Family? , 1996, Journal of Cognitive Neuroscience.

[41]  A. Mecklinger,et al.  Recognition Memory for Emotional and Neutral Faces: An Event-Related Potential Study , 2004, Journal of Cognitive Neuroscience.

[42]  M. Junghöfer,et al.  The selective processing of briefly presented affective pictures: an ERP analysis. , 2004, Psychophysiology.

[43]  P. Barnard,et al.  Disgust Enhances the Recollection of Negative Emotional Images , 2011, PloS one.

[44]  T. Münte,et al.  Memory recall in arousing situations – an emotional von Restorff effect? , 2006, BMC Neuroscience.

[45]  Michael J Meaney,et al.  Epigenetic programming by maternal behavior , 2004, Nature Neuroscience.

[46]  A. Gasbarri,et al.  Working Memory for Emotional Facial Expressions: Role of Estrogen in Humans and Non-Human Primates , 2008, Reviews in the neurosciences.

[47]  Margaret Bradley,et al.  Event-related potential studies of language and emotion: words, phrases, and task effects. , 2006, Progress in brain research.

[48]  J. Arndt,et al.  Taboo words: The effect of emotion on memory for peripheral information , 2009, Memory & cognition.

[49]  K. Scherer,et al.  The voices of wrath: brain responses to angry prosody in meaningless speech , 2005, Nature Neuroscience.

[50]  Jonas K. Olofsson,et al.  Affective picture processing: An integrative review of ERP findings , 2008, Biological Psychology.

[51]  Max Coltheart,et al.  The MRC Psycholinguistic Database , 1981 .

[52]  J L McGaugh,et al.  Amygdala activity at encoding correlated with long-term, free recall of emotional information. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[53]  E. Phelps Human emotion and memory: interactions of the amygdala and hippocampal complex , 2004, Current Opinion in Neurobiology.

[54]  John Polich,et al.  Affective recognition memory processing and event-related brain potentials , 2011, Cognitive, affective & behavioral neuroscience.

[55]  S. Kitayama,et al.  Interdependence modulates the brain response to word-voice incongruity. , 2010, Social cognitive and affective neuroscience.

[56]  R. Schandry,et al.  Implicit memory for emotional words is modulated by cardiac perception , 2010, Biological Psychology.

[57]  Martin Eimer,et al.  Rapid Detection of Emotion from Human Vocalizations , 2010, Journal of Cognitive Neuroscience.

[58]  Andrew B. L. Berry,et al.  A tale of two negatives: differential memory modulation by threat-related facial expressions. , 2011, Emotion.

[59]  Martin Kavaliers,et al.  Interplay of oxytocin, vasopressin, and sex hormones in the regulation of social recognition. , 2012, Behavioral neuroscience.

[60]  J. Goldstein,et al.  Estradiol Modulates Medial Prefrontal Cortex and Amygdala Activity During Fear Extinction in Women and Female Rats , 2011, Biological Psychiatry.

[61]  Soo Hong Chew,et al.  Genetics of Human Social Behavior , 2010, Neuron.

[62]  Bruno B Averbeck,et al.  Oxytocin and the salience of social cues , 2010, Proceedings of the National Academy of Sciences.

[63]  E. Kensinger,et al.  Neural Processing of Emotional Pictures and Words: A Comparison of Young and Older Adults , 2011, Developmental neuropsychology.

[64]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[65]  M. Rugg,et al.  An event-related potential study of recognition memory with and without retrieval of source. , 1996, Brain : a journal of neurology.

[66]  Rutvik H. Desai,et al.  The neurobiology of semantic memory , 2011, Trends in Cognitive Sciences.

[67]  Dennis D. Spencer,et al.  Memory for Emotional Words Following Unilateral Temporal Lobectomy , 1997, Brain and Cognition.

[68]  S. R. Schmidt Memory for emotional words in sentences: The importance of emotional contrast , 2012, Cognition & emotion.