Effects of tasks on BOLD signal responses to sentence contrasts: Review and commentary

Functional neuroimaging studies of syntactic processing have been interpreted as identifying the neural locations of parsing and interpretive operations. However, current behavioral studies of sentence processing indicate that many operations occur simultaneously with parsing and interpretation. In this review, we point to issues that arise in discriminating the effects of these concurrent processes from those of the parser/interpreter in neural measures and to approaches that may help resolve them.

[1]  Matthew H. Davis,et al.  Neural Response Suppression Predicts Repetition Priming of Spoken Words and Pseudowords , 2006, Journal of Cognitive Neuroscience.

[2]  M. MacDonald,et al.  Individual Differences and Probabilistic Constraints in Syntactic Ambiguity Resolution , 1995 .

[3]  Yosef Grodzinsky,et al.  Neuroimaging of syntax and syntactic processing , 2006, Current Opinion in Neurobiology.

[4]  Dominic W. Massaro,et al.  The motor theory of speech perception revisited , 2008, Psychonomic bulletin & review.

[5]  Mira Didic,et al.  Progressive Loss of Speech: A Neuropsychological Profile of Premotor Dysfunction , 1998, European Neurology.

[6]  David Caplan,et al.  Effects of Syntactic Structure and Propositional Number on Patterns of Regional Cerebral Blood Flow , 1998, Journal of Cognitive Neuroscience.

[7]  G. Waters,et al.  Activation of Broca's area by syntactic processing under conditions of concurrent articulation , 2000, Human brain mapping.

[8]  David Caplan,et al.  Syntactic and thematic constraint effects on BOLD signal correlates of comprehension of relative clauses , 2007, Brain and Language.

[9]  D. Poeppel,et al.  The cortical organization of speech processing , 2007, Nature Reviews Neuroscience.

[10]  S. Bressler,et al.  Causal influences in primate cerebral cortex during visual pattern discrimination , 2000, Neuroreport.

[11]  J. Trueswell,et al.  Cognitive control and parsing: Reexamining the role of Broca’s area in sentence comprehension , 2005, Cognitive, affective & behavioral neuroscience.

[12]  Matthias Schlesewsky,et al.  The extended argument dependency model: a neurocognitive approach to sentence comprehension across languages. , 2006, Psychological review.

[13]  J. Gee,et al.  Neural basis for sentence comprehension: Grammatical and short‐term memory components , 2002, Human brain mapping.

[14]  D. Gow Assimilation and Anticipation in Continuous Spoken Word Recognition , 2001 .

[15]  Rainer Goebel,et al.  Mapping directed influence over the brain using Granger causality and fMRI , 2005, NeuroImage.

[16]  Bob McMurray,et al.  Chapter 1 Word recognition and phonology : The case of English coronal place assimilation , 2006 .

[17]  F. Varela,et al.  Measuring phase synchrony in brain signals , 1999, Human brain mapping.

[18]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[19]  W. Singer,et al.  Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties , 1989, Nature.

[20]  Susan M. Garnsey,et al.  Semantic Influences On Parsing: Use of Thematic Role Information in Syntactic Ambiguity Resolution , 1994 .

[21]  E. Gibson Linguistic complexity: locality of syntactic dependencies , 1998, Cognition.

[22]  Irene P. Kan,et al.  Selection from perceptual and conceptual representations , 2004, Cognitive, affective & behavioral neuroscience.

[23]  Seppo P. Ahlfors,et al.  Lexical influences on speech perception: A Granger causality analysis of MEG and EEG source estimates , 2008, NeuroImage.

[24]  R. Ratcliff Modeling response signal and response time data , 2006, Cognitive Psychology.

[25]  Yosef Grodzinsky,et al.  Working memory and syntax interact in Broca's area , 2007, NeuroImage.

[26]  David Caplan,et al.  Functional Neuroimaging Studies of Syntactic Processing in Sentence Comprehension: A Critical Selective Review , 2007, Lang. Linguistics Compass.

[27]  W. Singer,et al.  Stimulus-specific neuronal oscillations in orientation columns of cat visual cortex. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[28]  M. Just,et al.  Brain Activation Modulated by Sentence Comprehension , 1996, Science.

[29]  C. Price The functional anatomy of word comprehension and production , 1998, Trends in Cognitive Sciences.

[30]  D. Kahneman,et al.  Attention and Effort , 1973 .

[31]  D. Gow Does English coronal place assimilation create lexical ambiguity , 2002 .

[32]  Peggy Gatignol,et al.  The role of dominant premotor cortex in language: a study using intraoperative functional mapping in awake patients , 2003, NeuroImage.

[33]  M K Tanenhaus,et al.  Eye Movements and Lexical Access in Spoken-Language Comprehension: Evaluating a Linking Hypothesis between Fixations and Linguistic Processing , 2000, Journal of psycholinguistic research.

[34]  Erik D. Reichle,et al.  Using E-Z reader to model the effects of higher level language processing on eye movements during reading , 2009, Psychonomic bulletin & review.

[35]  G. Ojemann,et al.  Cortical language localization in left, dominant hemisphere. An electrical stimulation mapping investigation in 117 patients. , 1989, Journal of neurosurgery.

[36]  R. Näätänen The perception of speech sounds by the human brain as reflected by the mismatch negativity (MMN) and its magnetic equivalent (MMNm). , 2001, Psychophysiology.

[37]  W. Soon,et al.  Polar bears of western Hudson Bay and climate change: Are warming spring air temperatures the “ultimate” survival control factor? , 2007 .

[38]  John J. B. Allen,et al.  EEG phase synchrony differences across visual perception conditions may depend on recording and analysis methods , 2005, Clinical Neurophysiology.

[39]  C. Fiebach,et al.  Revisiting the role of Broca's area in sentence processing: Syntactic integration versus syntactic working memory , 2005, Human brain mapping.

[40]  David Poeppel,et al.  Pure word deafness and the bilateral processing of the speech code , 2001, Cogn. Sci..

[41]  A D Friederici,et al.  Syntactic Working Memory and the Establishment of Filler-Gap Dependencies: Insights from ERPs and fMRI , 2001, Journal of psycholinguistic research.

[42]  L. Faes,et al.  Assessment of Granger Causality by Nonlinear Model Identification: Application to Short-term Cardiovascular Variability , 2008, Annals of Biomedical Engineering.

[43]  P. Gordon,et al.  Similarity-based interference during language comprehension: Evidence from eye tracking during reading. , 2006, Journal of experimental psychology. Learning, memory, and cognition.

[44]  B. C. Griffith,et al.  The discrimination of speech sounds within and across phoneme boundaries. , 1957, Journal of experimental psychology.

[45]  Peter König,et al.  On the directionality of cortical interactions studied by structural analysis of electrophysiological recordings , 1999, Biological Cybernetics.

[46]  David Caplan,et al.  Individual differences in rCBF correlates of syntactic processing in sentence comprehension: effects of working memory and speed of processing , 2003, NeuroImage.

[47]  David Caplan,et al.  Syntactic and Thematic Constraint Effects on Blood Oxygenation Level Dependent Signal Correlates of Comprehension of Relative Clauses , 2008, Journal of Cognitive Neuroscience.

[48]  D. Swinney,et al.  A Functional Neuroimaging Investigation of the Roles of Structural Complexity and Task-Demand During Auditory Sentence Processing , 2006, Cortex.

[49]  W. Penfield,et al.  SOMATIC MOTOR AND SENSORY REPRESENTATION IN THE CEREBRAL CORTEX OF MAN AS STUDIED BY ELECTRICAL STIMULATION , 1937 .

[50]  Fernanda Ferreira,et al.  The misinterpretation of noncanonical sentences , 2003, Cognitive Psychology.

[51]  R. Henson What can Functional Neuroimaging Tell the Experimental Psychologist? , 2005, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[52]  P. Denes On the Motor Theory of Speech Perception , 1965 .

[53]  D Norris,et al.  Merging information in speech recognition: Feedback is never necessary , 2000, Behavioral and Brain Sciences.

[54]  D. Poeppel,et al.  Dorsal and ventral streams: a framework for understanding aspects of the functional anatomy of language , 2004, Cognition.

[55]  Colin M. Brown,et al.  Syntactic Processing in Left Prefrontal Cortex Is Independent of Lexical Meaning , 2001, NeuroImage.

[56]  W. Singer,et al.  Response to: Yuval-Greenberg et al., “Transient Induced Gamma-Band Response in EEG as a Manifestation of Miniature Saccades.” Neuron 58, 429–441 , 2009, Neuron.

[57]  J. Pernier,et al.  Oscillatory γ-Band (30–70 Hz) Activity Induced by a Visual Search Task in Humans , 1997, The Journal of Neuroscience.

[58]  M. Just,et al.  From the SelectedWorks of Marcel Adam Just 1992 A capacity theory of comprehension : Individual differences in working memory , 2017 .

[59]  William D. Marslen-Wilson,et al.  Mechanisms of phonological inference in speech perception. , 1998, Journal of experimental psychology. Human perception and performance.

[60]  G. Altmann,et al.  The real-time mediation of visual attention by language and world knowledge: Linking anticipatory (and other) eye movements to linguistic processing , 2007 .

[61]  Emily B. Myers,et al.  The neural bases of the lexical effect: an fMRI investigation. , 2008, Cerebral cortex.

[62]  C. Granger Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[63]  Holger Mitterer,et al.  Coping with phonological assimilation in speech perception: Evidence for early compensation , 2003, Perception & psychophysics.

[64]  S. Bookheimer,et al.  Form and Content Dissociating Syntax and Semantics in Sentence Comprehension , 1999, Neuron.

[65]  I. Nelken,et al.  Transient Induced Gamma-Band Response in EEG as a Manifestation of Miniature Saccades , 2008, Neuron.

[66]  Erik D. Reichle,et al.  The E-Z Reader model of eye-movement control in reading: Comparisons to other models , 2003, Behavioral and Brain Sciences.

[67]  W. Marslen-Wilson,et al.  Mechanisms of phonological inference in speech perception. , 1998, Journal of experimental psychology. Human perception and performance.

[68]  H. White,et al.  Cointegration, causality, and forecasting : a festschrift in honour of Clive W.J. Granger , 1999 .

[69]  R. Llinás,et al.  Human oscillatory brain activity near 40 Hz coexists with cognitive temporal binding. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[70]  David Poeppel,et al.  The analysis of speech in different temporal integration windows: cerebral lateralization as 'asymmetric sampling in time' , 2003, Speech Commun..

[71]  M. Page,et al.  What Can't Functional Neuroimaging Tell the Cognitive Psychologist? , 2006, Cortex.

[72]  T. Hendler,et al.  The Neural Reality of Syntactic Transformations , 2003, Psychological science.

[73]  D. Gow,et al.  Articulatory mediation of speech perception: A causal analysis of multi-modal imaging data , 2009, Cognition.

[74]  Julie C. Sedivy,et al.  Eye movements and spoken language comprehension: Effects of visual context on syntactic ambiguity resolution , 2002, Cognitive Psychology.

[75]  G. McCarthy,et al.  Language-related field potentials in the anterior-medial temporal lobe: II. Effects of word type and semantic priming , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[76]  Mitchel S Berger,et al.  Functional outcome after language mapping for glioma resection. , 2008, The New England journal of medicine.

[77]  David Caplan,et al.  Localization of Syntactic Comprehension by Positron Emission Tomography , 1998, NeuroImage.

[78]  Robin K. Morris,et al.  Working memory, animacy, and verb class in the processing of relative clauses , 2005 .

[79]  W. Ganong Phonetic categorization in auditory word perception. , 1980, Journal of experimental psychology. Human perception and performance.

[80]  R. Levy Expectation-based syntactic comprehension , 2008, Cognition.

[81]  James B. Elsner,et al.  Granger causality and Atlantic hurricanes , 2007 .

[82]  Julie C. Sedivy,et al.  Subject Terms: Linguistics Language Eyes & eyesight Cognition & reasoning , 1995 .

[83]  A. Seth Causal connectivity of evolved neural networks during behavior. , 2005, Network.

[84]  Robin K. Morris,et al.  Processing Subject and Object Relative Clauses: Evidence from Eye Movements , 2002 .

[85]  Yosef Grodzinsky,et al.  Neural correlates of syntactic movement: converging evidence from two fMRI experiments , 2004, NeuroImage.

[86]  David W. Gow,et al.  A cross-linguistic examination of assimilation context effects , 2004 .

[87]  G. Waters,et al.  PET Studies of Syntactic Processing with Auditory Sentence Presentation , 1999, NeuroImage.

[88]  A. Dale,et al.  Improved Localizadon of Cortical Activity by Combining EEG and MEG with MRI Cortical Surface Reconstruction: A Linear Approach , 1993, Journal of Cognitive Neuroscience.

[89]  Mingzhou Ding,et al.  Analyzing information flow in brain networks with nonparametric Granger causality , 2008, NeuroImage.

[90]  Frank H. Guenther,et al.  An fMRI investigation of syllable sequence production , 2006, NeuroImage.

[91]  O. Bertrand,et al.  Oscillatory gamma activity in humans and its role in object representation , 1999, Trends in Cognitive Sciences.

[92]  Carlos Gussenhoven,et al.  Laboratory Phonology 7 , 2002 .

[93]  John W Belliveau,et al.  Monte Carlo simulation studies of EEG and MEG localization accuracy , 2002, Human brain mapping.

[94]  J. Myerson,et al.  General slowing of nonverbal information processing: evidence for a power law. , 1987, Journal of gerontology.

[95]  Morten H. Christiansen,et al.  Reassessing Working Memory: Comment on Just and Carpenter (1992) and Waters and Caplan (1996) , 2002 .

[96]  Maryellen C. MacDonald,et al.  The lexical nature of syntactic ambiguity resolution , 1994 .

[97]  A. Hollingworth,et al.  Thematic Roles Assigned along the Garden Path Linger , 2001, Cognitive Psychology.

[98]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[99]  D. Gow Feature parsing: Feature cue mapping in spoken word recognition , 2003, Perception & psychophysics.

[100]  A. Liberman,et al.  The motor theory of speech perception revised , 1985, Cognition.

[101]  Susan M. Garnsey,et al.  Evoked potentials and the study of sentence comprehension , 1989, Journal of psycholinguistic research.

[102]  S. Bressler,et al.  Beta oscillations in a large-scale sensorimotor cortical network: directional influences revealed by Granger causality. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[103]  Anders M. Dale,et al.  Spectral spatiotemporal imaging of cortical oscillations and interactions in the human brain , 2004, NeuroImage.

[104]  K. A. Ericsson,et al.  Long-term working memory. , 1995, Psychological review.

[105]  David Caplan,et al.  Task-dependent and task-independent neurovascular responses to syntactic processing , 2008, Cortex.

[106]  Sophie K. Scott,et al.  The functional neuroanatomy of prelexical processing in speech perception , 2004, Cognition.

[107]  David Caplan,et al.  Determinants of Bold Signal Correlates of Processing Object-Extracted Relative Clauses , 2006, Cortex.

[108]  Sydney S. Cash,et al.  Parallel versus serial processing dependencies in the perisylvian speech network: A Granger analysis of intracranial EEG data , 2009, Brain and Language.

[109]  E. T. Possing,et al.  Human temporal lobe activation by speech and nonspeech sounds. , 2000, Cerebral cortex.

[110]  Emily B. Myers,et al.  An event-related fMRI investigation of phonological-lexical competition , 2004, Brain and Language.

[111]  David W. Gow,et al.  How representations help define computational problems: commentary on Grossberg, Gaskell and Greenberg , 2003, J. Phonetics.

[112]  W. Hesse,et al.  The use of time-variant EEG Granger causality for inspecting directed interdependencies of neural assemblies , 2003, Journal of Neuroscience Methods.

[113]  Mingzhou Ding,et al.  Evaluating causal relations in neural systems: Granger causality, directed transfer function and statistical assessment of significance , 2001, Biological Cybernetics.

[114]  Richard L. Lewis,et al.  Computational principles of working memory in sentence comprehension , 2006, Trends in Cognitive Sciences.

[115]  Randall Hendrick,et al.  Memory-Load Interference in Syntactic Processing , 2002, Psychological science.

[116]  C. Fowler An event approach to the study of speech perception from a direct realist perspective , 1986 .

[117]  Michael J. Spivey,et al.  Gradiency and Visual Context in Syntactic Garden-Paths. , 2007, Journal of memory and language.

[118]  D. Caplan Task effects on BOLD signal correlates of implicit syntactic processing , 2010, Language and cognitive processes.

[119]  Matthias M. Müller,et al.  Directed Cortical Information Flow during Human Object Recognition: Analyzing Induced EEG Gamma-Band Responses in Brain's Source Space , 2007, PloS one.

[120]  C Büchel,et al.  Brain regions involved in articulation , 1999, The Lancet.