Resting-state connectivity reveals a role for sensorimotor systems in vocal emotional processing in children

Voices are a primary source of emotional information in everyday interactions. Being able to process non-verbal vocal emotional cues, namely those embedded in speech prosody, impacts on our behaviour and communication. Extant research has delineated the role of temporal and inferior frontal brain regions for vocal emotional processing. A growing number of studies also suggest the involvement of the motor system, but little is known about such potential involvement. Using resting-state fMRI, we ask if the patterns of motor system intrinsic connectivity play a role in emotional prosody recognition in children. Fifty-five 8-year-old children completed an emotional prosody recognition task and a resting-state scan. Better performance in emotion recognition was predicted by a stronger connectivity between the inferior frontal gyrus (IFG) and motor regions including primary motor, lateral premotor and supplementary motor sites. This is mostly driven by the IFG pars triangularis and cannot be explained by differences in domain-general cognitive abilities. These findings indicate that individual differences in the engagement of sensorimotor systems, and in its coupling with inferior frontal regions, underpin variation in children's emotional speech perception skills. They suggest that sensorimotor and higher-order evaluative processes interact to aid emotion recognition, and have implications for models of vocal emotional communication.

[1]  São Luís Castro,et al.  Not all sounds sound the same: Parkinson's disease affects differently emotion processing in music and in speech prosody , 2013, Journal of clinical and experimental neuropsychology.

[2]  S. Frühholz,et al.  Perceiving emotional expressions in others: Activation likelihood estimation meta-analyses of explicit evaluation, passive perception and incidental perception of emotions , 2016, Neuroscience & Biobehavioral Reviews.

[3]  J K Hietanen,et al.  Emotion recognition and social adjustment in school-aged girls and boys. , 2001, Scandinavian journal of psychology.

[4]  Stephen M. Smith,et al.  Improved Optimization for the Robust and Accurate Linear Registration and Motion Correction of Brain Images , 2002, NeuroImage.

[5]  Sonja A. Kotz,et al.  Emotion, Language, and the Brain , 2011, Lang. Linguistics Compass.

[6]  Leslie G. Ungerleider,et al.  Transient and sustained activity in a distributed neural system for human working memory , 1997, Nature.

[7]  J. Shimony,et al.  Resting-State fMRI: A Review of Methods and Clinical Applications , 2013, American Journal of Neuroradiology.

[8]  J. Halberstadt,et al.  Verbosity and emotion recognition in older adults. , 2010, Psychology and aging.

[9]  Stephen M. Smith,et al.  Permutation inference for the general linear model , 2014, NeuroImage.

[10]  J. Lewine,et al.  Relations Between Nonverbal and Verbal Social Cognitive Skills and Complex Social Behavior in Children and Adolescents with Autism , 2016, Journal of abnormal child psychology.

[11]  Pierre Maurage,et al.  Adaptation to Vocal Expressions Reveals Multistep Perception of Auditory Emotion , 2014, The Journal of Neuroscience.

[12]  Max Kuhn,et al.  Building Predictive Models in R Using the caret Package , 2008 .

[13]  S. Kotz,et al.  Accepted Manuscript Title : The sound of emotions — Towards a unifying neural network perspective of affective sound processing , 2016 .

[14]  Pascal Belin,et al.  Dorsal and Ventral Pathways for Prosody , 2015, Current Biology.

[15]  P. Ferrari,et al.  Mu desynchronization during observation and execution of facial expressions in 30-month-old children , 2016, Developmental Cognitive Neuroscience.

[16]  S. Scott,et al.  Positive Emotions Preferentially Engage an Auditory–Motor “Mirror” System , 2006, The Journal of Neuroscience.

[17]  S. Scott,et al.  High emotional contagion and empathy are associated with enhanced detection of emotional authenticity in laughter , 2018, Quarterly journal of experimental psychology.

[18]  Sophie K Scott,et al.  Suppressing Sensorimotor Activity Modulates the Discrimination of Auditory Emotions But Not Speaker Identity , 2010, The Journal of Neuroscience.

[19]  T. Klingberg,et al.  Changes in cortical activity after training of working memory — a single-subject analysis , 2007, Physiology & Behavior.

[20]  Joseph T. Devlin,et al.  The hearing ear is always found close to the speaking tongue: Review of the role of the motor system in speech perception , 2017, Brain and Language.

[21]  L. Fuchs,et al.  Neural predictors of individual differences in response to math tutoring in primary-grade school children , 2013, Proceedings of the National Academy of Sciences.

[22]  D. Louis Collins,et al.  Unbiased average age-appropriate atlases for pediatric studies , 2011, NeuroImage.

[23]  P. Strick,et al.  Frontal lobe inputs to primate motor cortex: evidence for four somatotopically organized ‘premotor’ areas , 1979, Brain Research.

[24]  S. West,et al.  The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis. , 1996 .

[25]  E Burdet,et al.  Somatotopic Mapping of the Developing Sensorimotor Cortex in the Preterm Human Brain , 2018, Cerebral cortex.

[26]  J. Attems,et al.  White matter connections of the supplementary motor area in humans , 2014, Journal of Neurology, Neurosurgery & Psychiatry.

[27]  Scott K. Holland,et al.  Prosodic processing by children: An fMRI study , 2006, Brain and Language.

[28]  H. Wagner.  On measuring performance in category judgment studies of nonverbal behavior , 1993 .

[29]  D. Wildgruber,et al.  Emotional voice areas: anatomic location, functional properties, and structural connections revealed by combined fMRI/DTI. , 2012, Cerebral cortex.

[30]  C. Almli,et al.  Unbiased nonlinear average age-appropriate brain templates from birth to adulthood , 2009, NeuroImage.

[31]  H. Lu,et al.  Resting-State Functional Connectivity in Rat Brain , 2005 .

[32]  John C. Mazziotta,et al.  Mirroring others' emotions relates to empathy and interpersonal competence in children , 2008, NeuroImage.

[33]  Kimberly L. Ray,et al.  Meta-analytic evidence for a superordinate cognitive control network subserving diverse executive functions , 2012, Cognitive, affective & behavioral neuroscience.

[34]  Sophie K. Scott,et al.  Brain mechanisms for processing perceived emotional vocalizations in humans , 2009 .

[35]  Xi-Nian Zuo,et al.  Resting-State Functional Connectivity Indexes Reading Competence in Children and Adults , 2011, The Journal of Neuroscience.

[36]  Yinjuan Du,et al.  Noise differentially impacts phoneme representations in the auditory and speech motor systems , 2014, Proceedings of the National Academy of Sciences.

[37]  Sophie K. Scott,et al.  Discriminating between Auditory and Motor Cortical Responses to Speech and Nonspeech Mouth Sounds , 2011, Journal of Cognitive Neuroscience.

[38]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[39]  P. Goldman-Rakic,et al.  Activation of human prefrontal cortex during spatial and nonspatial working memory tasks measured by functional MRI. , 1996, Cerebral cortex.

[40]  César F. Lima,et al.  Beatboxers and Guitarists Engage Sensorimotor Regions Selectively When Listening to the Instruments They can Play , 2018, Cerebral cortex.

[41]  Corinna E. Löckenhoff,et al.  Age differences in recognition of emotion in lexical stimuli and facial expressions. , 2007, Psychology and aging.

[42]  Matthew Brett,et al.  Rhythm and Beat Perception in Motor Areas of the Brain , 2007, Journal of Cognitive Neuroscience.

[43]  J. Morgan,et al.  Do infants discriminate non-linguistic vocal expressions of positive emotions? , 2017, Cognition & emotion.

[44]  Didier Grandjean,et al.  Bilateral dorsal and ventral fiber pathways for the processing of affective prosody identified by probabilistic fiber tracking , 2015, NeuroImage.

[45]  São Luís Castro,et al.  Recognizing emotions in spoken language: A validated set of Portuguese sentences and pseudosentences for research on emotional prosody , 2010, Behavior research methods.

[46]  Nigel MacLennan,et al.  Assessment and Analysis , 2017 .

[47]  S. K. Scott,et al.  Individual Differences in Laughter Perception Reveal Roles for Mentalizing and Sensorimotor Systems in the Evaluation of Emotional Authenticity , 2013, Cerebral cortex.

[48]  U. Jürgens,et al.  Cortical lesion effects and vocalization in the squirrel monkey , 1982, Brain Research.

[49]  S. Dehaene,et al.  Functional Neuroimaging of Speech Perception in Infants , 2002, Science.

[50]  A. Lacroix,et al.  Inferring Emotions from Speech Prosody: Not So Easy at Age Five , 2013, PloS one.

[51]  T. Striano,et al.  Infants' electric brain responses to emotional prosody , 2005, Neuroreport.

[52]  Niels Birbaumer,et al.  Reorganization of functional and effective connectivity during real-time fMRI-BCI modulation of prosody processing , 2011, Brain and Language.

[53]  Daniel M. Corcos,et al.  Three-dimensional locations and boundaries of motor and premotor cortices as defined by functional brain imaging: A meta-analysis , 2006, NeuroImage.

[54]  Stuart Rosen,et al.  A positron emission tomography study of the neural basis of informational and energetic masking effects in speech perception. , 2004, The Journal of the Acoustical Society of America.

[55]  T. Flash,et al.  Negative blood oxygenation level dependent homunculus and somatotopic information in primary motor cortex and supplementary motor area , 2012, Proceedings of the National Academy of Sciences.

[56]  Bruce Fischl,et al.  Accurate and robust brain image alignment using boundary-based registration , 2009, NeuroImage.

[57]  D. Grandjean,et al.  Processing of emotional vocalizations in bilateral inferior frontal cortex , 2013, Neuroscience & Biobehavioral Reviews.

[58]  Pascale Tremblay,et al.  Fiber tracking of the frontal aslant tract and subcomponents of the arcuate fasciculus in 5–8-year-olds: Relation to speech and language function , 2015, Brain and Language.

[59]  Erin B. McClure,et al.  Associations Between Social Anxiety and Nonverbal Processing Skill in Preadolescent Boys and Girls , 2001 .

[60]  César F. Lima,et al.  Reduced Laughter Contagion in Boys at Risk for Psychopathy , 2017, Current Biology.

[61]  Sonja A. Kotz,et al.  The development of cross-cultural recognition of vocal emotion during childhood and adolescence , 2018, Scientific Reports.

[62]  Sophie K. Scott,et al.  A little more conversation, a little less action — candidate roles for the motor cortex in speech perception , 2009, Nature Reviews Neuroscience.

[63]  César F. Lima,et al.  Roles of Supplementary Motor Areas in Auditory Processing and Auditory Imagery , 2016, Trends in Neurosciences.

[64]  G. McCarthy,et al.  Functional organization of human supplementary motor cortex studied by electrical stimulation , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[65]  Francesca Happé,et al.  Children's recognition of emotions from vocal cues. , 2013, The British journal of developmental psychology.

[66]  Annett Schirmer,et al.  Is the voice an auditory face? An ALE meta-analysis comparing vocal and facial emotion processing , 2017, Social cognitive and affective neuroscience.

[67]  Didier Grandjean,et al.  Multiple subregions in superior temporal cortex are differentially sensitive to vocal expressions: A quantitative meta-analysis , 2013, Neuroscience & Biobehavioral Reviews.

[68]  P. Matthews,et al.  Distinct patterns of brain activity in young carriers of the APOE e4 allele , 2009, NeuroImage.

[69]  M. Pell,et al.  Preferential decoding of emotion from human non-linguistic vocalizations versus speech prosody , 2015, Biological Psychology.

[70]  D. Wildgruber,et al.  Emotional voices in context: a neurobiological model of multimodal affective information processing. , 2011, Physics of life reviews.

[71]  Sophie K. Scott,et al.  Feel the Noise: Relating Individual Differences in Auditory Imagery to the Structure and Function of Sensorimotor Systems , 2015, Cerebral cortex.

[72]  Alberto Llera,et al.  ICA-AROMA: A robust ICA-based strategy for removing motion artifacts from fMRI data , 2015, NeuroImage.

[73]  Angela D. Friederici,et al.  The ontogeny of the cortical language network , 2016, Nature Reviews Neuroscience.

[74]  Nina F Dronkers,et al.  The role of inferior parietal and inferior frontal cortex in working memory. , 2006, Neuropsychology.

[75]  Clayton J. Baker.  “It’s Not About You” , 2010, Journal of general internal medicine.

[76]  Daniel C. Javitt,et al.  “It's Not What You Say, But How You Say it”: A Reciprocal Temporo-frontal Network for Affective Prosody , 2009, Front. Hum. Neurosci..

[77]  Didier Grandjean,et al.  Towards a fronto-temporal neural network for the decoding of angry vocal expressions , 2012, NeuroImage.

[78]  E. Nelson,et al.  Maturation of vocal emotion recognition: Insights from the developmental and neuroimaging literature , 2018, Neuroscience & Biobehavioral Reviews.

[79]  P. Heaton,et al.  Developmental change and cross-domain links in vocal and musical emotion recognition performance in childhood. , 2015, The British journal of developmental psychology.

[80]  L. Bahrick,et al.  The development of infant discrimination of affect in multimodal and unimodal stimulation: The role of intersensory redundancy. , 2007, Developmental psychology.

[81]  V. Gracco,et al.  White matter tractography of the neural network for speech-motor control in children who stutter , 2018, Neuroscience Letters.

[82]  G. Vingerhoets,et al.  Results of a pilot study on the involvement of bilateral inferior frontal gyri in emotional prosody perception: an rTMS study , 2010, BMC Neuroscience.

[83]  Mark H. Johnson,et al.  Early Specialization for Voice and Emotion Processing in the Infant Brain , 2011, Current Biology.

[84]  S. Nowicki,et al.  The association of children's nonverbal decoding abilities with their popularity, locus of control, and academic achievement. , 1992 .

[85]  Stephen M Smith,et al.  Fast robust automated brain extraction , 2002, Human brain mapping.

[86]  T. Vickery,et al.  Associating resting-state connectivity with trait impulsivity , 2017, Social cognitive and affective neuroscience.

[87]  Laurent Capelle,et al.  Somatotopy of the Supplementary Motor Area: Evidence from Correlation of the Extent of Surgical Resection with the Clinical Patterns of Deficit , 2002, Neurosurgery.

[88]  D. Poeppel,et al.  Mental imagery of speech implicates two mechanisms of perceptual reactivation , 2016, Cortex.

[89]  R. C. Oldfield.  The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[90]  São Luís Castro,et al.  Speaking to the trained ear: musical expertise enhances the recognition of emotions in speech prosody. , 2011, Emotion.

[91]  R. Adolphs,et al.  Emotion Perception from Face, Voice, and Touch: Comparisons and Convergence , 2017, Trends in Cognitive Sciences.

[92]  Elizabeth Jefferies,et al.  An individual differences analysis of the neurocognitive architecture of the semantic system at rest , 2016, Brain and Cognition.

[93]  Umberto Castiello,et al.  The role of the frontal aslant tract and premotor connections in visually guided hand movements , 2017, NeuroImage.

[94]  Michel Thiebaut de Schotten,et al.  Short frontal lobe connections of the human brain , 2012, Cortex.

[95]  S. Kotz,et al.  Beyond the right hemisphere: brain mechanisms mediating vocal emotional processing , 2006, Trends in Cognitive Sciences.