Good, bad and ugly word stress – fMRI evidence for foot structure driven processing of prosodic violations

Using a stress violation paradigm, we investigated whether metrical feet constrain the way prosodic patterns are processed and evaluated. Processing of correctly versus incorrectly stressed words was associated with activation in left posterior angular and retrosplenial cortex, indicating the recognition of an expected and familiar pattern, whereas the inverse contrast yielded enhanced bilateral activation in the superior temporal gyrus, reflecting higher costs in auditory (re-)analysis. More fine-grained analyses of severe versus mild stress violations revealed activations of the left superior temporal and left anterior angular gyrus whereas the opposite contrast led to frontal activations including Broca's area and its right-hemisphere homologue, suggesting that detection of mild violations lead to increased effort in working memory and deeper phonological processing. Our results provide first evidence that different incorrect stress patterns are processed in a qualitatively different way and that the underlying foot structure seems to determine potential stress positions in German words.

[1]  E. Maguire,et al.  What does the retrosplenial cortex do? , 2009, Nature Reviews Neuroscience.

[2]  C. Féry German Word Stress in Optimality Theory , 1998 .

[3]  Angela D. Friederici,et al.  Brain potentials indicate immediate use of prosodic cues in natural speech processing , 1999, Nature Neuroscience.

[4]  D. V. von Cramon,et al.  Neurocognition of auditory sentence comprehension: event related fMRI reveals sensitivity to syntactic violations and task demands. , 2000, Brain research. Cognitive brain research.

[5]  R. Wiese,et al.  The influence of rhythmic (ir)regularities on speech processing: Evidence from an ERP study on German phrases , 2013, Neuropsychologia.

[6]  Peter Eisenberg Syllabische Struktur und Wortakzent. Prinzipien der Prosodik deutscher Wörter , 1991 .

[7]  Frank Domahs,et al.  Neuro-cognitive foundations of word stress processing - evidence from fMRI , 2011, Behavioral and Brain Functions.

[8]  B. Levine,et al.  The functional neuroanatomy of autobiographical memory: A meta-analysis , 2006, Neuropsychologia.

[9]  Elisabeth Selkirk,et al.  Phonology and syntax , 1984 .

[10]  Heinz J. Giegerich Metrical Phonology and Phonological Structure: German and English , 1985 .

[11]  J. Vroomen,et al.  An ERP correlate of metrical stress in spoken word recognition. , 1999, Psychophysiology.

[12]  W. Levelt Models of word production , 1999, Trends in Cognitive Sciences.

[13]  J. Mehler,et al.  Language discrimination by newborns: toward an understanding of the role of rhythm. , 1998, Journal of experimental psychology. Human perception and performance.

[14]  A. Cutler,et al.  Exploring the Role of Lexical stress in Lexical Recognition , 2005, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[15]  Bernard Mazoyer,et al.  Meta-analyzing left hemisphere language areas: Phonology, semantics, and sentence processing , 2006, NeuroImage.

[16]  Erika Kaltenbacher Typologische Aspekte des Wortakzents , 1994 .

[17]  Frank Domahs,et al.  Going on with optimised feet: Evidence for the interaction between segmental and metrical structure in phonological encoding from a case of primary progressive aphasia , 2008 .

[18]  Anne Cutler,et al.  The role of strong syllables in segmentation for lexical access , 1988 .

[19]  R. Miall,et al.  Brain activation patterns during measurement of sub- and supra-second intervals , 2003, Neuropsychologia.

[20]  Walter Huber,et al.  A supramodal brain substrate of word form processing — An fMRI study on homonym finding with auditory and visual input , 2011, Brain Research.

[21]  Suzanne Dikker,et al.  Before the N400: Effects of lexical–semantic violations in visual cortex , 2011, Brain and Language.

[22]  S. Mattys,et al.  The perception of primary and secondary stress in English , 2000, Perception & psychophysics.

[23]  A. Cutler,et al.  Voornaam is not (really) a Homophone: Lexical Prosody and Lexical Access in Dutch , 2001, Language and speech.

[24]  Lutz Jäncke,et al.  The Neural Correlate of Speech Rhythm as Evidenced by Metrical Speech Processing , 2008, Journal of Cognitive Neuroscience.

[25]  Emily B. Myers,et al.  The neural bases of the lexical effect: an fMRI investigation. , 2008, Cerebral cortex.

[26]  Anne Cutler,et al.  A theory of lexical access in speech production , 1999, Behavioral and Brain Sciences.

[27]  Mario Dzemidzic,et al.  Neural circuitry underlying sentence-level linguistic prosody , 2005, NeuroImage.

[28]  S. Weis,et al.  Sex Hormones: Modulators of Interhemispheric Inhibition in the Human Brain , 2010, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[29]  B. Hayes Metrical Stress Theory: Principles and Case Studies , 1995 .

[30]  Steven E. Petersen,et al.  Manipulation of Length and Lexicality Localizes the Functional Neuroanatomy of Phonological Processing in Adult Readers , 2011, Journal of Cognitive Neuroscience.

[31]  K. Zilles,et al.  The neural correlates of person familiarity. A functional magnetic resonance imaging study with clinical implications. , 2001, Brain : a journal of neurology.

[32]  Elia Formisano,et al.  The functional neuroanatomy of metrical stress evaluation of perceived and imagined spoken words. , 2004, Cerebral cortex.

[33]  Cathy J. Price,et al.  Top-down modulation of ventral occipito-temporal responses during visual word recognition , 2011, NeuroImage.

[34]  M. Bar,et al.  Cortical Analysis of Visual Context , 2003, Neuron.

[35]  S. Soto-Faraco,et al.  Journal of Memory and Language , 2001 .

[36]  S. Kotz,et al.  Rhythm's gonna get you: Regular meter facilitates semantic sentence processing , 2012, Neuropsychologia.

[37]  Kai Alter,et al.  Processing prosodic boundaries in natural and hummed speech: an FMRI study. , 2008, Cerebral cortex.

[38]  Mireille Besson,et al.  Musicians and the Metric Structure of Words , 2011, Journal of Cognitive Neuroscience.

[39]  M. Schlesewsky,et al.  The processing of German word stress: evidence for the prosodic hierarchy* , 2008, Phonology.

[40]  J. Gee,et al.  Prosodic structure and spoken word recognition , 1987, Cognition.

[41]  Jian Kong,et al.  The neural substrate of arithmetic operations and procedure complexity. , 2005, Brain research. Cognitive brain research.

[42]  Johannes Knaus,et al.  Stress “deafness” in a Language with Fixed Word Stress: An ERP Study on Polish , 2012, Front. Psychology.

[43]  W. Sturm,et al.  Dynamic changes in functional cerebral connectivity of spatial cognition during the menstrual cycle , 2011, Human brain mapping.

[44]  R. Kronland-Martinet,et al.  Influence of syllabic lengthening on semantic processing in spoken French: behavioral and electrophysiological evidence. , 2007, Cerebral cortex.

[45]  M. Delazer,et al.  Learning complex arithmetic--an fMRI study. , 2003, Brain research. Cognitive brain research.

[46]  A. Friederici,et al.  Brain activity varies with modulation of dynamic pitch variance in sentence melody , 2004, Brain and Language.

[47]  S. Petersen,et al.  A developmental fMRI study of reading and repetition reveals changes in phonological and visual mechanisms over age. , 2008, Cerebral cortex.

[48]  Christa Neuper,et al.  Fact learning in complex arithmetic and figural‐spatial tasks: The role of the angular gyrus and its relation to mathematical competence , 2009, Human brain mapping.

[49]  C K Friedrich,et al.  An electrophysiological response to different pitch contours in words , 2001, Neuroreport.

[50]  James R. Booth,et al.  Development of Brain Mechanisms for Processing Orthographic and Phonologic Representations , 2004, Journal of Cognitive Neuroscience.

[51]  Ping Li,et al.  Cortical Dynamics of Acoustic and Phonological Processing in Speech Perception , 2011, PloS one.

[52]  James R. Booth,et al.  Functional Anatomy of Intra- and Cross-Modal Lexical Tasks , 2002, NeuroImage.

[53]  Nadim Joni Shah,et al.  Probabilistic fibre tract analysis of cytoarchitectonically defined human inferior parietal lobule areas reveals similarities to macaques , 2011, NeuroImage.

[54]  S. Kotz,et al.  Event-related potential responses to metric violations: rules versus meaning , 2010, Neuroreport.

[55]  G. Schwarzer,et al.  Can you hear a difference? Neuronal correlates of melodic deviance processing in children , 2011, Brain Research.

[56]  S. Kotz,et al.  Cortical speech processing unplugged: a timely subcortico-cortical framework , 2010, Trends in Cognitive Sciences.

[57]  Richard Wiese,et al.  The Phonology of German , 1996 .

[58]  B. Mazoyer,et al.  Neural Correlates of Simple and Complex Mental Calculation , 2001, NeuroImage.

[59]  L. Gerken,et al.  A metrical template account of children's weak syllable omissions from multisyllabic words , 1994, Journal of Child Language.

[60]  Stefan Zysset,et al.  Gender differences in the activation of inferior frontal cortex during emotional speech perception , 2004, NeuroImage.

[61]  Ulrike Janßen Untersuchungen zum Wortakzent im Deutschen und Niederländischen , 2004 .

[62]  Matthew H. Davis,et al.  A complementary systems account of word learning: neural and behavioural evidence , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[63]  Ulrike Domahs,et al.  Experimental evidence for optimal and minimal metrical structure of German word prosody , 2009 .

[64]  J. Obleser,et al.  Expectancy constraints in degraded speech modulate the language comprehension network. , 2010, Cerebral cortex.

[65]  Sonja A. Kotz,et al.  Event-related Brain Potentials Suggest a Late Interaction of Meter and Syntax in the P600 , 2009, Journal of Cognitive Neuroscience.

[66]  R. Wiese,et al.  Processing (un-)predictable word stress: ERP evidence from Turkish , 2013 .

[67]  Frank Domahs,et al.  Structural Factors Affecting the Assignment of Word Stress in German , 2012, Journal of Germanic Linguistics.

[68]  M. W. Brown,et al.  Fos expression in the rostral thalamic nuclei and associated cortical regions in response to different spatial memory tests , 2000, Neuroscience.

[69]  Claudia K. Friedrich,et al.  Pitch modulates lexical identification in spoken word recognition: ERP and behavioral evidence. , 2004, Brain research. Cognitive brain research.

[70]  H. Ackermann,et al.  Cerebral processing of linguistic and emotional prosody: fMRI studies. , 2006, Progress in brain research.

[71]  James R. Booth,et al.  Developmental changes in the neural correlates of semantic processing , 2006, NeuroImage.

[72]  B. Alber Quantity Sensitivity as the Result of Constraint Interaction , 1997 .

[73]  William J. Idsardi,et al.  The computation of prosody , 1992 .

[74]  Anne Cutler,et al.  The use of prosodic information in word recognition , 1984 .

[75]  D. V. von Cramon,et al.  FMRI reveals brain regions mediating slow prosodic modulations in spoken sentences , 2002, Human brain mapping.