Differentiating Phrase Structure Parsing and Memory Retrieval in the Brain

On some level, human sentence comprehension must involve both memory retrieval and structural composition. This study differentiates these two processes using neuroimaging data collected during naturalistic listening. Retrieval is formalized in terms of “multiword expressions” while structure-building is formalized in terms of bottom-up parsing. The results most strongly implicate Anterior Temporal regions for structure-building and Precuneus Cortex for memory retrieval.

[1]  N. Dronkers,et al.  Lesion analysis of the brain areas involved in language comprehension , 2004, Cognition.

[2]  M. Just,et al.  Neuroimaging Contributions to the Understanding of Discourse Processes , 2006 .

[3]  Isabelle Tellier,et al.  Evaluating the Impact of External Lexical Resources into a CRF-based Multiword Segmenter and Part-of-Speech Tagger , 2012, LREC.

[4]  Richard S. J. Frackowiak,et al.  The Mind's Eye—Precuneus Activation in Memory-Related Imagery , 1995, NeuroImage.

[5]  E. Bullmore,et al.  Methods for diagnosis and treatment of stimulus‐correlated motion in generic brain activation studies using fMRI , 1999, Human brain mapping.

[6]  R. Malach,et al.  Syntactic structure building in the anterior temporal lobe during natural story listening , 2012, Brain and Language.

[7]  Benedikt A. Poser,et al.  Multi-echo fMRI: A review of applications in fMRI denoising and analysis of BOLD signals , 2017, NeuroImage.

[8]  R. C. Oldfield.  The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[9]  A. Goldberg.  Constructions at Work: The Nature of Generalization in Language , 2006 .

[10]  Wen-Ming Luh,et al.  Differentiating BOLD and non-BOLD signals in fMRI time series using multi-echo EPI , 2012, NeuroImage.

[11]  Andrea Bergmann,et al.  Statistical Parametric Mapping The Analysis Of Functional Brain Images , 2016 .

[12]  R. Jackendoff.  Foundations of Language: Brain, Meaning, Grammar, Evolution , 2002 .

[13]  N C Andreasen,et al.  Remembering the past: two facets of episodic memory explored with positron emission tomography. , 1995, The American journal of psychiatry.

[14]  S. Dehaene,et al.  Cortical representation of the constituent structure of sentences , 2011, Proceedings of the National Academy of Sciences.

[15]  M Teräs,et al.  PET studies on the memory processing of word pairs in bilingual Finnish–English subjects , 2002, Behavioural Brain Research.

[16]  R. Nathan Spreng,et al.  The Common Neural Basis of Autobiographical Memory, Prospection, Navigation, Theory of Mind, and the Default Mode: A Quantitative Meta-analysis , 2009, Journal of Cognitive Neuroscience.

[17]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[18]  Brian Murphy,et al.  Simultaneously Uncovering the Patterns of Brain Regions Involved in Different Story Reading Subprocesses , 2014, PloS one.

[19]  Michael Eickenberg,et al.  Machine learning for neuroimaging with scikit-learn , 2014, Front. Neuroinform..

[20]  M. Ullman.  Contributions of memory circuits to language: the declarative/procedural model , 2004, Cognition.

[21]  Liina Pylkkänen,et al.  Simple Composition: A Magnetoencephalography Investigation into the Comprehension of Minimal Linguistic Phrases , 2011, The Journal of Neuroscience.

[22]  Adam Makkai,et al.  A Dictionary of American Idioms , 1995 .

[23]  Marc Brysbaert,et al.  Moving beyond Kučera and Francis: A critical evaluation of current word frequency norms and the introduction of a new and improved word frequency measure for American English , 2009, Behavior research methods.

[24]  Dan Klein,et al.  Accurate Unlexicalized Parsing , 2003, ACL.

[25]  Mikkel Wallentin,et al.  Accessing the mental space—Spatial working memory processes for language and vision overlap in precuneus , 2008, Human brain mapping.

[26]  Timothy Baldwin,et al.  Multiword Expressions: A Pain in the Neck for NLP , 2002, CICLing.

[27]  N. Mashal,et al.  The role of the precuneus in metaphor comprehension: evidence from an fMRI study in people with schizophrenia and healthy participants , 2014, Front. Hum. Neurosci..

[28]  Cristina Cacciari,et al.  Processing multiword idiomatic strings: Many words in one? , 2014 .

[29]  P. Tabossi,et al.  Why are idioms recognized fast? , 2009, Memory & cognition.

[30]  M. Ullman.  A neurocognitive perspective on language: The declarative/procedural model , 2001, Nature Reviews Neuroscience.

[31]  Timothy O'Donnell,et al.  Productivity and Reuse in Language: A Theory of Linguistic Computation and Storage , 2015 .

[32]  P. Tabossi,et al.  The comprehension of idioms. , 1988 .

[33]  John Hale,et al.  Automaton Theories of Human Sentence Comprehension , 2014 .

[34]  Peter Hagoort,et al.  The neurobiology of language beyond single-word processing , 2019, Science.

[35]  Thomas E. Nichols,et al.  Non-white noise in fMRI: Does modelling have an impact? , 2006, NeuroImage.

[36]  Evelyn C. Ferstl,et al.  The extended language network: A meta‐analysis of neuroimaging studies on text comprehension , 2008, Human brain mapping.