Temporal signatures of processing voiceness and emotion in sound

Abstract This study explored the temporal course of vocal and emotional sound processing. Participants detected rare repetitions in a stimulus stream comprising neutral and surprised non-verbal exclamations and spectrally rotated control sounds. Spectral rotation preserved some acoustic and emotional properties of the vocal originals. Event-related potentials elicited to unrepeated sounds revealed effects of voiceness and emotion. Relative to non-vocal sounds, vocal sounds elicited a larger centro-parietally distributed N1. This effect was followed by greater positivity to vocal relative to non-vocal sounds beginning with the P2 and extending throughout the recording epoch (N4, late positive potential) with larger amplitudes in female than in male listeners. Emotion effects overlapped with the voiceness effects but were smaller and differed topographically. Voiceness and emotion interacted only for the late positive potential, which was greater for vocal-emotional as compared with all other sounds. Taken together, these results point to a multi-stage process in which voiceness and emotionality are represented independently before being integrated in a manner that biases responses to stimuli with socio-emotional relevance.

[1]  T. Penney,et al.  Detecting Temporal Change in Dynamic Sounds: On the Role of Stimulus Duration, Speed, and Emotion , 2016, Front. Psychol..

[2]  T. Allison,et al.  Electrophysiological Studies of Face Perception in Humans , 1996, Journal of Cognitive Neuroscience.

[3]  Annett Schirmer,et al.  Vocal emotions influence verbal memory: Neural correlates and interindividual differences , 2013, Cognitive, affective & behavioral neuroscience.

[4]  R. Zatorre,et al.  Voice-selective areas in human auditory cortex , 2000, Nature.

[5]  Didier Grandjean,et al.  Specific brain networks during explicit and implicit decoding of emotional prosody. , 2012, Cerebral cortex.

[6]  J. Armony,et al.  Time course of the influence of musical expertise on the processing of vocal and musical sounds , 2015, Neuroscience.

[7]  R. Adorni,et al.  Neural markers of a greater female responsiveness to social stimuli , 2008, BMC Neuroscience.

[8]  Pascal Belin,et al.  Amygdala responses to nonlinguistic emotional vocalizations , 2007, NeuroImage.

[9]  S. Bentin,et al.  Processing specificity for human voice stimuli: electrophysiological evidence , 2001, Neuroreport.

[10]  Alice Mado Proverbio,et al.  Sex differences in the brain response to affective scenes with or without humans , 2009, Neuropsychologia.

[11]  A. Proverbio,et al.  Women are better at seeing faces where there are none: an ERP study of face pareidolia. , 2016, Social cognitive and affective neuroscience.

[12]  Christoph Kayser,et al.  Who is That? Brain Networks and Mechanisms for Identifying Individuals , 2015, Trends in Cognitive Sciences.

[13]  Angela D. Friederici,et al.  Sex differences in the preattentive processing of vocal emotional expressions , 2005, Neuroreport.

[14]  Dan Foti,et al.  Deconstructing Reappraisal: Descriptions Preceding Arousing Pictures Modulate the Subsequent Neural Response , 2008, Journal of Cognitive Neuroscience.

[15]  R. Näätänen,et al.  The mismatch negativity (MMN) in basic research of central auditory processing: A review , 2007, Clinical Neurophysiology.

[16]  E Donchin,et al.  On how P300 amplitude varies with the utility of the eliciting stimuli. , 1978, Electroencephalography and clinical neurophysiology.

[17]  Annett Schirmer,et al.  Listen up! Processing of intensity change differs for vocal and nonvocal sounds , 2007, Brain Research.

[18]  Anqi Qiu,et al.  Emotional expressions in voice and music: Same code, same effect? , 2013, Human brain mapping.

[19]  S. Scott,et al.  Positive Emotions Preferentially Engage an Auditory–Motor “Mirror” System , 2006, The Journal of Neuroscience.

[20]  Shuo Wang,et al.  Squeeze me, but don't tease me: Human and mechanical touch enhance visual attention and emotion discrimination , 2011, Social neuroscience.

[21]  Lonce L. Wyse,et al.  Perceptual and Conceptual Priming of Environmental Sounds , 2011, Journal of Cognitive Neuroscience.

[22]  Stephanie Clarke,et al.  A Temporal Hierarchy for Conspecific Vocalization Discrimination in Humans , 2010, The Journal of Neuroscience.

[23]  Christoph S. Herrmann,et al.  Auditory rhythms entrain visual processes in the human brain: Evidence from evoked oscillations and event-related potentials , 2015, NeuroImage.

[24]  M. Pell,et al.  Preferential decoding of emotion from human non-linguistic vocalizations versus speech prosody , 2015, Biological Psychology.

[25]  Trevor B. Penney,et al.  On the functional role of temporal and frontal cortex activation in passive detection of auditory deviance , 2008, NeuroImage.

[26]  Jonas Obleser,et al.  Now you hear it, now you don't: transient traces of consonants and their nonspeech analogues in the human brain. , 2006, Cerebral cortex.

[27]  Angela D. Friederici,et al.  Frequency of Maternal Touch Predicts Resting Activity and Connectivity of the Developing Social Brain , 2016, Cerebral cortex.

[28]  Joachim Gross,et al.  The early spatio-temporal correlates and task independence of cerebral voice processing studied with MEG. , 2013, Cerebral cortex.

[29]  Dirk Wildgruber,et al.  Impact of personality on the cerebral processing of emotional prosody , 2011, NeuroImage.

[30]  Martin Eimer,et al.  Rapid Detection of Emotion from Human Vocalizations , 2010, Journal of Cognitive Neuroscience.

[31]  Pascal Belin,et al.  Electrophysiological evidence for an early processing of human voices , 2009, BMC Neuroscience.

[32]  R. Adolphs,et al.  Emotion Perception from Face, Voice, and Touch: Comparisons and Convergence , 2017, Trends in Cognitive Sciences.

[33]  F. Gosselin,et al.  The Montreal Affective Voices: A validated set of nonverbal affect bursts for research on auditory affective processing , 2008, Behavior research methods.

[34]  S. Scott,et al.  Identification of a pathway for intelligible speech in the left temporal lobe. , 2000, Brain : a journal of neurology.

[35]  G. Yovel,et al.  A unified coding strategy for processing faces and voices , 2013, Trends in Cognitive Sciences.

[36]  S. Hillyard,et al.  Modulation of early auditory processing during selective listening to rapidly presented tones. , 1991, Electroencephalography and clinical neurophysiology.

[37]  Sonja A. Kotz,et al.  Early emotional prosody perception based on different speaker voices , 2008, Neuroreport.

[38]  A. Pinheiro,et al.  Salience in a social landscape: electrophysiological effects of task-irrelevant and infrequent vocal change. , 2016, Social cognitive and affective neuroscience.

[39]  W. Miltner,et al.  Visual Attention Modulates Brain Activation to Angry Voices , 2011, The Journal of Neuroscience.

[40]  G. Thierry,et al.  Event-related potential study of attention capture by affective sounds , 2007, Neuroreport.

[41]  Pascal Belin,et al.  Is voice processing species-specific in human auditory cortex? An fMRI study , 2004, NeuroImage.

[42]  T. Penney,et al.  Emotional Voices Distort Time: Behavioral and Neural Correlates , 2016 .

[43]  S. Kotz,et al.  ERP Evidence for a Sex-Specific Stroop Effect in Emotional Speech , 2003, Journal of Cognitive Neuroscience.

[44]  T. Penney,et al.  Humans Process Dog and Human Facial Affect in Similar Ways , 2013, PloS one.

[45]  Mikko Sams,et al.  Representation of perceived sound valence in the human brain , 2012, Human brain mapping.

[46]  Anne Lacheret,et al.  FMRI study of emotional speech comprehension. , 2006, Cerebral cortex.

[47]  Ruben C. Gur,et al.  Not Pitch Perfect: Sensory Contributions to Affective Communication Impairment in Schizophrenia , 2011, Biological Psychiatry.

[48]  W. Grodd,et al.  The voices of seduction: cross-gender effects in processing of erotic prosody. , 2007, Social cognitive and affective neuroscience.

[49]  R. Simons,et al.  Intentional modulation of emotional responding to unpleasant pictures: an ERP study. , 2006, Psychophysiology.

[50]  Pascal Belin,et al.  Gender differences in the temporal voice areas , 2014, Front. Neurosci..

[51]  Teemu Rinne,et al.  The functional role of the frontal cortex in pre-attentive auditory change detection , 2013, NeuroImage.

[52]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[53]  A. Friederici,et al.  On the lateralization of emotional prosody: An event-related functional MR investigation , 2003, Brain and Language.

[54]  W. Meck,et al.  The Socio-Temporal Brain: Connecting People in Time , 2016, Trends in Cognitive Sciences.

[55]  T. Gunter,et al.  The right touch: Stroking of CT-innervated skin promotes vocal emotion processing , 2017, Cognitive, Affective, & Behavioral Neuroscience.

[56]  A. Bidet-Caulet,et al.  Early neurophysiological correlates of vocal versus non-vocal sound processing in adults , 2013, Brain Research.