A Structure-based Memory Maintenance Model for Neural Tracking of Linguistic Structures

It is recently demonstrated that cortical activity can track the time courses of phrases and sentences during speech listening. Here, we propose a plausible neural processing framework to explain this phenomenon. It is argued that the brain maintains the neural representation of a linguistic unit, i.e., a word or a phrase, in a processing buffer until the unit is integrated into a higher-level structure. After being integrated, the unit is removed from the buffer and becomes activated long-term memory. In this model, the duration each unit is maintained in the processing buffer depends on the linguistic structure of the speech input. It is shown that the number of items retained in the processing buffer follows the time courses of phrases and sentences, in line with neurophysiological data, whether the syntactic structure of a sentence is mentally parsed using a bottom-up or top-down predictive model. This model generates a range of testable predictions about the link between linguistic structures, their dynamic psychological representations and their neural underpinnings.

[1]  J. Fodor,et al.  The psychological reality of linguistic segments , 1965 .

[2]  Lucia Melloni,et al.  Brain Oscillations during Spoken Sentence Processing , 2012, Journal of Cognitive Neuroscience.

[3]  W. Marslen-Wilson,et al.  The temporal structure of spoken language understanding , 1980, Cognition.

[4]  M. Just,et al.  From the SelectedWorks of Marcel Adam Just 1992 A capacity theory of comprehension : Individual differences in working memory , 2017 .

[5]  Nick Chater,et al.  The Now-or-Never bottleneck: A fundamental constraint on language , 2015, Behavioral and Brain Sciences.

[6]  A Prince,et al.  Optimality: From Neural Networks to Universal Grammar , 1997, Science.

[7]  W. Ma,et al.  Changing concepts of working memory , 2014, Nature Neuroscience.

[8]  Peter Hagoort,et al.  Syntactic Unification Operations Are Reflected in Oscillatory Dynamics during On-line Sentence Comprehension , 2010, Journal of Cognitive Neuroscience.

[9]  G. Waters,et al.  Verbal working memory and sentence comprehension , 1999, Behavioral and Brain Sciences.

[10]  Miao‐kun Sun,et al.  Trends in cognitive sciences , 2012 .

[11]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[12]  D. Poeppel,et al.  Cortical Tracking of Hierarchical Linguistic Structures in Connected Speech , 2015, Nature Neuroscience.

[13]  Robert C. Berwick,et al.  The Grammatical Basis of Linguistic Performance: Language Use and Acquisition , 1986 .

[14]  W. Luh,et al.  Abstract linguistic structure correlates with temporal activity during naturalistic comprehension , 2016, Brain and Language.

[15]  Mark S. Seidenberg,et al.  Sentence processing and the clause boundary , 1978 .

[16]  Randall Hendrick,et al.  Memory-Load Interference in Syntactic Processing , 2002, Psychological science.

[17]  J. Fodor,et al.  The active use of grammar in speech perception , 1966 .

[18]  K. Rayner,et al.  Making and correcting errors during sentence comprehension: Eye movements in the analysis of structurally ambiguous sentences , 1982, Cognitive Psychology.

[19]  A. Friederici Towards a neural basis of auditory sentence processing , 2002, Trends in Cognitive Sciences.

[20]  Janet D. Fodor,et al.  The sausage machine: A new two-stage parsing model , 1978, Cognition.

[21]  B McElree,et al.  Working memory and focal attention. , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[22]  P. Carpenter,et al.  Individual differences in working memory and reading , 1980 .

[23]  Kara D. Federmeier,et al.  Electrophysiology reveals semantic memory use in language comprehension , 2000, Trends in Cognitive Sciences.

[24]  Noam Chomsky,et al.  वाक्यविन्यास का सैद्धान्तिक पक्ष = Aspects of the theory of syntax , 1965 .

[25]  Andrea E Martin,et al.  A mechanism for the cortical computation of hierarchical linguistic structure , 2017, PLoS biology.

[26]  Stephani Foraker,et al.  Memory structures that subserve sentence comprehension , 2003 .

[27]  Lars Meyer,et al.  Linguistic Bias Modulates Interpretation of Speech via Neural Delta-Band Oscillations , 2016, Cerebral cortex.

[28]  Thomas G. Bever,et al.  Sentence Comprehension: The Integration of Habits and Rules , 2001 .

[29]  C. Phillips Linear Order and Constituency , 2003, Linguistic Inquiry.

[30]  Morten H. Christiansen,et al.  How hierarchical is language use? , 2012, Proceedings of the Royal Society B: Biological Sciences.

[31]  R. Malach,et al.  Syntactic structure building in the anterior temporal lobe during natural story listening , 2012, Brain and Language.

[32]  S. Dehaene,et al.  Cortical representation of the constituent structure of sentences , 2011, Proceedings of the National Academy of Sciences.

[33]  L. Pylkkänen,et al.  Basic linguistic composition recruits the left anterior temporal lobe and left angular gyrus during both listening and reading. , 2013, Cerebral cortex.

[34]  Hui Chen,et al.  Amnesia for Object Attributes , 2015, Psychological science.

[35]  Peter Hagoort,et al.  Frequency-based Segregation of Syntactic and Semantic Unification during Online Sentence Level Language Comprehension , 2015, Journal of Cognitive Neuroscience.

[36]  Stanislas Dehaene,et al.  Neurophysiological dynamics of phrase-structure building during sentence processing , 2017, Proceedings of the National Academy of Sciences.

[37]  Richard L. Lewis,et al.  Computational principles of working memory in sentence comprehension , 2006, Trends in Cognitive Sciences.

[38]  Karl G. D. Bailey,et al.  Good-Enough Representations in Language Comprehension , 2002 .

[39]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[40]  Susan M. Garnsey,et al.  Semantic Influences On Parsing: Use of Thematic Role Information in Syntactic Ambiguity Resolution , 1994 .

[41]  E. Gibson Linguistic complexity: locality of syntactic dependencies , 1998, Cognition.

[42]  Edward Gibson,et al.  Consequences of the Serial Nature of Linguistic Input for Sentenial Complexity , 2005, Cogn. Sci..