Neural decoding of discriminative auditory object features depends on their socio-affective valence.

Human voices consist of specific patterns of acoustic features that are considerably enhanced during affective vocalizations. These acoustic features are presumably used by listeners to accurately discriminate between acoustically or emotionally similar vocalizations. Here we used high-field 7T functional magnetic resonance imaging in human listeners together with a so-called experimental 'feature elimination approach' to investigate neural decoding of three important voice features of two affective valence categories (i.e. aggressive and joyful vocalizations). We found a valence-dependent sensitivity to vocal pitch (f0) dynamics and to spectral high-frequency cues already at the level of the auditory thalamus. Furthermore, pitch dynamics and harmonics-to-noise ratio (HNR) showed overlapping, but again valence-dependent sensitivity in tonotopic cortical fields during the neural decoding of aggressive and joyful vocalizations, respectively. For joyful vocalizations we also revealed sensitivity in the inferior frontal cortex (IFC) to the HNR and pitch dynamics. The data thus indicate that several auditory regions were sensitive to multiple, rather than single, discriminative voice features. Furthermore, some regions partly showed a valence-dependent hypersensitivity to certain features, such as pitch dynamic sensitivity in core auditory regions and in the IFC for aggressive vocalizations, and sensitivity to high-frequency cues in auditory belt and parabelt regions for joyful vocalizations.

[1]  Russell A. Poldrack,et al.  Deconvolving BOLD activation in event-related designs for multivoxel pattern classification analyses , 2012, NeuroImage.

[2]  Daniel C. Javitt,et al.  “It's Not What You Say, But How You Say it”: A Reciprocal Temporo-frontal Network for Affective Prosody , 2009, Front. Hum. Neurosci..

[3]  Bruno B Averbeck,et al.  Neural representation of vocalizations in the primate ventrolateral prefrontal cortex. , 2005, Journal of neurophysiology.

[4]  D. Grandjean,et al.  The role of the medial temporal limbic system in processing emotions in voice and music , 2014, Progress in Neurobiology.

[5]  K. Hammerschmidt,et al.  Acoustical correlates of affective prosody. , 2007, Journal of voice : official journal of the Voice Foundation.

[6]  R. Zatorre,et al.  Voice-selective areas in human auditory cortex , 2000, Nature.

[7]  Tobias Kober,et al.  MP2RAGE, a self bias-field corrected sequence for improved segmentation and T1-mapping at high field , 2010, NeuroImage.

[8]  Karl J. Friston,et al.  Approaches to the cortical analysis of auditory objects , 2007, Hearing Research.

[9]  Steven Brown,et al.  Perception of affective and linguistic prosody: an ALE meta-analysis of neuroimaging studies. , 2014, Social cognitive and affective neuroscience.

[10]  Niels O. Schiller,et al.  Hearing feelings: A quantitative meta-analysis on the neuroimaging literature of emotional prosody perception , 2012, Neuropsychologia.

[11]  Paul Boersma,et al.  Praat, a system for doing phonetics by computer , 2002 .

[12]  Johan Sundberg,et al.  Effects of vocal loudness variation on spectrum balance as reflected by the alpha measure of long-term-average spectra of speech. , 2006, The Journal of the Acoustical Society of America.

[13]  T. Griffiths,et al.  Distinct Mechanisms for Processing Spatial Sequences and Pitch Sequences in the Human Auditory Brain , 2003, The Journal of Neuroscience.

[14]  Jörg Bahlmann,et al.  Predicting vocal emotion expressions from the human brain , 2013, Human brain mapping.

[15]  B. Balas,et al.  Personal Familiarity Influences the Processing of Upright and Inverted Faces in Infants , 2009, Front. Hum. Neurosci..

[16]  J. Kaas,et al.  Subdivisions of auditory cortex and processing streams in primates. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[17]  Wolfgang Grodd,et al.  Cerebral processing of emotional prosody—influence of acoustic parameters and arousal , 2008, NeuroImage.

[18]  M. Zaitsev,et al.  High resolution single-shot EPI at 7T , 2008, Magnetic Resonance Materials in Physics, Biology and Medicine.

[19]  Gérard Faucon,et al.  Temporal envelope processing in the human auditory cortex: Response and interconnections of auditory cortical areas , 2008, Hearing Research.

[20]  Didier Grandjean,et al.  Specific brain networks during explicit and implicit decoding of emotional prosody. , 2012, Cerebral cortex.

[21]  Manojkumar Saranathan,et al.  Visualization of intra-thalamic nuclei with optimized white-matter-nulled MPRAGE at 7T , 2014, NeuroImage.

[22]  N. Weinberger The medial geniculate, not the amygdala, as the root of auditory fear conditioning , 2011, Hearing Research.

[23]  Yale E Cohen,et al.  Acoustic features of rhesus vocalizations and their representation in the ventrolateral prefrontal cortex. , 2007, Journal of neurophysiology.

[24]  Christopher J Plack,et al.  Listening to urban soundscapes: Physiological validity of perceptual dimensions. , 2011, Psychophysiology.

[25]  S. Scott,et al.  Perceptual Cues in Nonverbal Vocal Expressions of Emotion , 2010 .

[26]  R W Guillery,et al.  The role of the thalamus in the flow of information to the cortex. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[27]  Dave R. M. Langers,et al.  Tonotopic mapping of human auditory cortex , 2014, Hearing Research.

[28]  Essa Yacoub,et al.  Spatial organization of frequency preference and selectivity in the human inferior colliculus , 2012, Nature Communications.

[29]  R. Patterson,et al.  The Processing of Temporal Pitch and Melody Information in Auditory Cortex , 2002, Neuron.

[30]  Didier Grandjean,et al.  Towards a fronto-temporal neural network for the decoding of angry vocal expressions , 2012, NeuroImage.

[31]  Nikolaus Kriegeskorte,et al.  Combining the tools: Activation- and information-based fMRI analysis , 2007, NeuroImage.

[32]  Didier Grandjean,et al.  Amygdala subregions differentially respond and rapidly adapt to threatening voices , 2013, Cortex.

[33]  M. Erb,et al.  Effects of prosodic emotional intensity on activation of associative auditory cortex , 2006, Neuroreport.

[34]  Martin N. Hebart,et al.  Human visual and parietal cortex encode visual choices independent of motor plans , 2012, NeuroImage.

[35]  Petri Laukka,et al.  Getting the cue: sensory contributions to auditory emotion recognition impairments in schizophrenia. , 2010, Schizophrenia bulletin.

[36]  Rainer Goebel,et al.  Information-based functional brain mapping. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[37]  J. Rauschecker Cortical processing of complex sounds , 1998, Current Opinion in Neurobiology.

[38]  Richard S. J. Frackowiak,et al.  Representation of the temporal envelope of sounds in the human brain. , 2000, Journal of neurophysiology.

[39]  Didier Grandjean,et al.  Talking in Fury: The Cortico-Subcortical Network Underlying Angry Vocalizations. , 2015, Cerebral cortex.

[40]  William J. Talkington,et al.  Human Cortical Organization for Processing Vocalizations Indicates Representation of Harmonic Structure as a Signal Attribute , 2009, The Journal of Neuroscience.

[41]  Didier Grandjean,et al.  Multiple subregions in superior temporal cortex are differentially sensitive to vocal expressions: A quantitative meta-analysis , 2013, Neuroscience & Biobehavioral Reviews.

[42]  K. Scherer,et al.  Acoustic profiles in vocal emotion expression. , 1996, Journal of personality and social psychology.

[43]  Edward L. Bartlett,et al.  Neural representations of temporally modulated signals in the auditory thalamus of awake primates. , 2007, Journal of neurophysiology.

[44]  Josh H. McDermott,et al.  Cortical Pitch Regions in Humans Respond Primarily to Resolved Harmonics and Are Located in Specific Tonotopic Regions of Anterior Auditory Cortex , 2013, The Journal of Neuroscience.

[45]  J. Rauschecker,et al.  Cortical Representation of Natural Complex Sounds: Effects of Acoustic Features and Auditory Object Category , 2010, The Journal of Neuroscience.

[46]  S. Kotz,et al.  Beyond the right hemisphere: brain mechanisms mediating vocal emotional processing , 2006, Trends in Cognitive Sciences.

[47]  K. Scherer,et al.  Mapping emotions into acoustic space: The role of voice production , 2011, Biological Psychology.

[48]  Karl J. Friston,et al.  Newcastle University Eprints This Work Is Licensed under a Creative Commons Attribution-noncommercial-sharealike 3.0 Unported License Features versus Feelings: Dissociable Representations of the Acoustic Features and Valence of Aversive Sounds , 2022 .

[49]  D. Grandjean,et al.  Processing of emotional vocalizations in bilateral inferior frontal cortex , 2013, Neuroscience & Biobehavioral Reviews.

[50]  Patrick McGillivray,et al.  Parallel coding of first and second order stimulus attributes , 2012, BMC Neuroscience.

[51]  M. Schönwiesner,et al.  Spectro-temporal modulation transfer function of single voxels in the human auditory cortex measured with high-resolution fMRI , 2009, Proceedings of the National Academy of Sciences.

[52]  J. Wenstrup,et al.  Frequency organization and responses to complex sounds in the medial geniculate body of the mustached bat. , 1999, Journal of neurophysiology.

[53]  Richard S. J. Frackowiak,et al.  Human Primary Auditory Cortex Follows the Shape of Heschl's Gyrus , 2011, The Journal of Neuroscience.

[54]  P. Laukka,et al.  Communication of emotions in vocal expression and music performance: different channels, same code? , 2003, Psychological bulletin.