Recognizing vocal expressions of emotion in patients with social skills deficits following traumatic brain injury

Abstract Perception of emotion in voice is impaired following traumatic brain injury (TBI). This study examined whether an inability to concurrently process semantic information (the “what”) and emotional prosody (the “how”) of spoken speech contributes to impaired recognition of emotional prosody and whether impairment is ameliorated when little or no semantic information is provided. Eighteen individuals with moderate-to-severe TBI showing social skills deficits during inpatient rehabilitation were compared with 18 demographically matched controls. Participants completed two discrimination tasks using spoken sentences that varied in the amount of semantic information: that is, (1) well-formed English, (2) a nonsense language, and (3) low-pass filtered speech producing “muffled” voices. Reducing semantic processing demands did not improve perception of emotional prosody. The TBI group were significantly less accurate than controls. Impairment was greater within the TBI group when accessing semantic memory to label the emotion of sentences, compared with simply making “same/different” judgments. Findings suggest an impairment of processing emotional prosody itself rather than semantic processing demands which leads to an over-reliance on the “what” rather than the “how” in conversational remarks. Emotional recognition accuracy was significantly related to the ability to inhibit prepotent responses, consistent with neuroanatomical research suggesting similar ventrofrontal systems subserve both functions. (JINS, 2010, 16, 369–382.)

[1]  Marc D. Pell,et al.  Cerebral mechanisms for understanding emotional prosody in speech , 2006, Brain and Language.

[2]  V. Croker,et al.  Recognition of emotion from facial expression following traumatic brain injury , 2005, Brain injury.

[3]  Susan Jerger,et al.  Developmental trends in the interaction between auditory and linguistic processing , 1993, Perception & psychophysics.

[4]  L. Pettersen Sensitivity to Emotional Cues and Social Behavior in Children and Adolescents after Head Injury , 1991, Perceptual and motor skills.

[5]  David Shum,et al.  Reliability and validity of The Awareness of Social Inference Test (TASIT): A clinical test of social perception , 2006, Disability and rehabilitation.

[6]  H. Jackson,et al.  Impaired Emotional Recognition Following Severe Head Injury , 1987, Cortex.

[7]  Shari R. Baum,et al.  Compensation for jaw fixation by aphasic patients under conditions of increased articulatory demands: a follow-up study , 1999 .

[8]  T. Shallice,et al.  Response suppression, initiation and strategy use following frontal lobe lesions , 1996, Neuropsychologia.

[9]  M. Pell,et al.  The Ability to Perceive and Comprehend Intonation in Linguistic and Affective Contexts by Brain-Damaged Adults , 1997, Brain and Language.

[10]  H. Whitaker,et al.  Effects of right and left hemisphere cerebrovascular lesions on discrimination of prosodic and semantic aspects of affect in sentences , 1992, Brain and Language.

[11]  K. Zilles,et al.  Recognition of emotional prosody and verbal components of spoken language: an fMRI study. , 2000, Brain research. Cognitive brain research.

[12]  Klaus R. Scherer,et al.  Vocal communication of emotion: A review of research paradigms , 2003, Speech Commun..

[13]  C. Tompkins,et al.  Perception of emotional intonation by brain-damaged adults: the influence of task processing levels. , 1985, Journal of speech and hearing research.

[14]  L. F. Barrett,et al.  A multiprocess perspective on the neuroscience of emotion. , 2001 .

[15]  Gina M. Grimshaw,et al.  Integration and Interference in the Cerebral Hemispheres: Relations with Hemispheric Specialization , 1998, Brain and Cognition.

[16]  Angela D. Friederici,et al.  Brain potentials indicate immediate use of prosodic cues in natural speech processing , 1999, Nature Neuroscience.

[17]  A R Damasio,et al.  Descartes' error and the future of human life. , 1994, Scientific American.

[18]  S. McDonald,et al.  Differential impairment in recognition of emotion across different media in people with severe traumatic brain injury , 2005, Journal of the International Neuropsychological Society.

[19]  J. Mazziotta,et al.  Modulating emotional responses: effects of a neocortical network on the limbic system , 2000, Neuroreport.

[20]  J. Filoteo,et al.  Semantic priming in patients with right frontal lobe lesions , 2005, Journal of the International Neuropsychological Society.

[21]  Alan Peters,et al.  Association and Auditory Cortices , 1985, Cerebral Cortex.

[22]  D. Schön,et al.  Emotional prosody: sex differences in sensitivity to speech melody , 2002, Trends in Cognitive Sciences.

[23]  P. Roth,et al.  Missing Data in Multiple Item Scales: A Monte Carlo Analysis of Missing Data Techniques , 1999 .

[24]  J R Pomerantz,et al.  Electrophysiologic indices of Stroop and Garner interference reveal linguistic influences on auditory and visual processing. , 1997, Journal of the American Academy of Audiology.

[25]  John F. Brandt,et al.  An auditory Stroop effect for pitch, loudness, and time , 1989, Brain and Language.

[26]  Sophie K. Scott,et al.  Impaired auditory recognition of fear and anger following bilateral amygdala lesions , 1997, Nature.

[27]  S. Behrens The perception of stress and lateralization of prosody , 1985, Brain and Language.

[28]  Alexander L. Francis,et al.  Electrophysiological Evidence for Early Interaction between Talker and Linguistic Information during Speech Perception , 2006 .

[29]  J. Patton,et al.  Factor structure of the Barratt impulsiveness scale. , 1995, Journal of clinical psychology.

[30]  K. Heilman,et al.  Comprehension of emotional prosody following unilateral hemispheric lesions: Processing defect versus distraction defect , 1987, Neuropsychologia.

[31]  A. Damasio,et al.  Failure to respond autonomically to anticipated future outcomes following damage to prefrontal cortex. , 1996, Cerebral cortex.

[32]  Duncan R Babbage,et al.  The importance of vocal affect to bimodal processing of emotion: implications for individuals with traumatic brain injury. , 2009, Journal of communication disorders.

[33]  M. Lezak Living with the characterologically altered brain injured patient. , 1978, The Journal of clinical psychiatry.

[34]  J. Ponsford,et al.  Cognitive functioning ten years following traumatic brain injury and rehabilitation. , 2008, Neuropsychology.

[35]  Ursula Hess,et al.  Deficits in decoding emotional facial expressions in Parkinson’s disease , 2004, Neuropsychologia.

[36]  R. Adolphs Recognizing emotion from facial expressions: psychological and neurological mechanisms. , 2002, Behavioral and cognitive neuroscience reviews.

[37]  R. Bell,et al.  Aggression after traumatic brain injury: Analysing socially desirable responses and the nature of aggressive traits , 2006, Brain injury.

[38]  R. Elliott,et al.  The neural response to emotional prosody, as revealed by functional magnetic resonance imaging , 2003, Neuropsychologia.

[39]  Scott A Langenecker,et al.  Face Emotion Perception and Executive Functioning Deficits in Depression , 2005, Journal of clinical and experimental neuropsychology.

[40]  W. McKinlay,et al.  The five year outcome of severe blunt head injury: a relative's view. , 1986, Journal of neurology, neurosurgery, and psychiatry.

[41]  R. Robinson,et al.  Mechanism of disinhibition after brain lesions. , 1997, The Journal of nervous and mental disease.

[42]  Brian Levine,et al.  Ventral frontal cortex functions and quantified MRI in traumatic brain injury , 2008, Neuropsychologia.

[43]  J. Montepare,et al.  Emotion processing in the visual and auditory domains by patients with Alzheimer's disease , 1999, Journal of the International Neuropsychological Society.

[44]  S. Rauch,et al.  Neurobiology of emotion perception I: the neural basis of normal emotion perception , 2003, Biological Psychiatry.

[45]  S. Dikmen,et al.  Emotional and behavioral adjustment after traumatic brain injury. , 1999, Archives of physical medicine and rehabilitation.

[46]  G. Bonanno,et al.  Emotions : current issues and future directions , 2001 .

[47]  R. E. Passingham,et al.  Cerebral cortex, vol. 4, association and auditory cortices A. Peters andE. G. Jones (eds). Plenum Press, New York (1985). 359 pp. £52.25 , 1987, Neuroscience.

[48]  K M Heilman,et al.  Comprehension of affective and nonaffective prosody , 1984, Neurology.

[49]  M. Pell,et al.  Processing emotional tone from speech in Parkinson’s disease: A role for the basal ganglia , 2003, Cognitive, affective & behavioral neuroscience.

[50]  Arvid Kappas,et al.  Multichannel communication of emotion: Synthetic signal production. , 1988 .

[51]  J Aharon-Peretz,et al.  Impaired “Affective Theory of Mind” Is Associated with Right Ventromedial Prefrontal Damage , 2005, Cognitive and behavioral neurology : official journal of the Society for Behavioral and Cognitive Neurology.

[52]  Skye McDonald,et al.  Clinical Insights into Pragmatic Theory: Frontal Lobe Deficits and Sarcasm , 1996, Brain and Language.

[53]  E. Rolls,et al.  Face and voice expression identification in patients with emotional and behavioural changes following ventral frontal lobe damage , 1996, Neuropsychologia.

[54]  Using a temporal discounting paradigm to measure decision-making and impulsivity following traumatic brain injury: A pilot study , 2008, Brain injury.

[55]  I. Daum,et al.  Processing of Affective Stimuli in Alcoholism , 2005, Cortex.

[56]  A. Friederici,et al.  On the lateralization of emotional prosody: An event-related functional MR investigation , 2003, Brain and Language.

[57]  Edgar Erdfelder,et al.  G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences , 2007, Behavior research methods.

[58]  M. Milders,et al.  Neuropsychological Impairments and Changes in Emotional and Social Behaviour Following Severe Traumatic Brain Injury , 2003, Journal of clinical and experimental neuropsychology.

[59]  I. Linnankoski,et al.  Expression or emotional-motivational connotations with a one-word utterance. , 1997, The Journal of the Acoustical Society of America.

[60]  J. Jerger,et al.  Processing of affective prosody and lexical-semantics in spoken utterances as differentiated by event-related potentials. , 2004, Brain research. Cognitive brain research.

[61]  E. Plante,et al.  Recognition of vocal and facial cues to affect in language-impaired and normally-developing preschoolers. , 2004, Journal of communication disorders.

[62]  J. Vroomen,et al.  The perception of emotions by ear and by eye , 2000 .

[63]  I. V. Thomsen,et al.  Late outcome of very severe blunt head trauma: a 10-15 year second follow-up. , 1984, Journal of neurology, neurosurgery, and psychiatry.

[64]  K. Scherer,et al.  The voices of wrath: brain responses to angry prosody in meaningless speech , 2005, Nature Neuroscience.

[65]  M. Cannito,et al.  Comprehension and expression of affective sentences in traumatic brain injury , 2001 .

[66]  Sonja A. Kotz,et al.  Factors in the recognition of vocally expressed emotions: A comparison of four languages , 2009, J. Phonetics.

[67]  E. Frank,et al.  Recognition of Nonverbal Communication of Affect Following Traumatic Brain Injury , 2000 .

[68]  Skye McDonald,et al.  Social perception deficits after traumatic brain injury: interaction between emotion recognition, mentalizing ability, and social communication. , 2004, Neuropsychology.

[69]  S. Langenecker,et al.  Impulsivity and Traumatic Brain Injury: The Relations Among Behavioral Observation, Performance Measures, and Rating Scales , 2008, The Journal of head trauma rehabilitation.

[70]  K. Cicerone,et al.  Disturbance of social cognition after traumatic orbitofrontal brain injury. , 1997, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[71]  E. Ross,et al.  fMRI evidence for the effect of verbal complexity on lateralisation of the neural response associated with decoding prosodic emotion , 2008, Neuropsychologia.

[72]  M. Pell,et al.  The neural bases of prosody: Insights from lesion studies and neuroimaging , 1999 .

[73]  M Freedman,et al.  Orbitofrontal function, object alternation and perseveration. , 1998, Cerebral cortex.

[74]  L. Gerstman,et al.  The perception of emotionally toned sentences by right hemisphere-damaged and aphasic subjects , 1976, Brain and Language.

[75]  P. Ekman Pictures of Facial Affect , 1976 .

[76]  Gary R Turner,et al.  Deficits in facial emotion perception in adults with recent traumatic brain injury , 2004, Neuropsychologia.

[77]  J. Douglas,et al.  Long-term ability to interpret facial expression after traumatic brain injury and its relation to social integration , 2009, Brain and Cognition.

[78]  G. Broe,et al.  Psychosocial outcome for the survivors of severe blunt head injury: the results from a consecutive series of 100 patients. , 1989, Journal of neurology, neurosurgery, and psychiatry.

[79]  R. Adolphs,et al.  A Role for Somatosensory Cortices in the Visual Recognition of Emotion as Revealed by Three-Dimensional Lesion Mapping , 2000, The Journal of Neuroscience.

[80]  S. McDonald,et al.  Treating deficits in emotion perception following traumatic brain injury , 2008, Neuropsychological rehabilitation.

[81]  D. V. von Cramon,et al.  FMRI reveals brain regions mediating slow prosodic modulations in spoken sentences , 2002, Human brain mapping.

[82]  B. Jennett Assessment of the severity of head injury. , 1976, Journal of neurology, neurosurgery, and psychiatry.

[83]  James S Babb,et al.  Brain atrophy in mild or moderate traumatic brain injury: a longitudinal quantitative analysis. , 2002, AJNR. American journal of neuroradiology.

[84]  P. Jensen,et al.  Three discourse profiles of closed-head-injury speakers: theoretical and clinical implications. , 1992, Brain injury.

[85]  Anne Lacheret,et al.  FMRI study of emotional speech comprehension. , 2006, Cerebral cortex.

[86]  Skye McDonald,et al.  An Exploration of Causes of Non-Literal Language Problems in Individuals with Asperger Syndrome , 2004, Journal of autism and developmental disorders.

[87]  M. Ietswaart,et al.  Longitudinal aspects of emotion recognition in patients with traumatic brain injury , 2008, Neuropsychologia.

[88]  E. Ross,et al.  Neurology of affective prosody and its functional–anatomic organization in right hemisphere , 2008, Brain and Language.

[89]  H. Levin,et al.  Serial MRI and neurobehavioural findings after mild to moderate closed head injury. , 1992, Journal of neurology, neurosurgery, and psychiatry.

[90]  T. Johnstone,et al.  The voice of emotion: an FMRI study of neural responses to angry and happy vocal expressions. , 2006, Social cognitive and affective neuroscience.

[91]  K. Pribram,et al.  Perception and Memory of Facial Affect following Brain Injury , 1982, Perceptual and motor skills.

[92]  B Jennett,et al.  Epidemiology of head injury. , 1981, Archives of disease in childhood.

[93]  K. Cicerone,et al.  Definition of mild traumatic brain injury , 1993 .

[94]  E. Ross,et al.  Lateralization of Affective Prosody in Brain and the Callosal Integration of Hemispheric Language Functions , 1997, Brain and Language.

[95]  A. Fort,et al.  Bimodal speech: early suppressive visual effects in human auditory cortex , 2004, The European journal of neuroscience.