A Biologically Plausible Parser

Abstract We describe a parser of English effectuated by biologically plausible neurons and synapses, and implemented through the Assembly Calculus, a recently proposed computational framework for cognitive function. We demonstrate that this device is capable of correctly parsing reasonably nontrivial sentences.1 While our experiments entail rather simple sentences in English, our results suggest that the parser can be extended beyond what we have implemented, to several directions encompassing much of language. For example, we present a simple Russian version of the parser, and discuss how to handle recursion, embedding, and polysemy.

[1]  Eghbal A. Hosseini,et al.  The neural architecture of language: Integrative modeling converges on predictive processing , 2020, Proceedings of the National Academy of Sciences.

[2]  İpek Pınar Uzun.  Kitap Tanıtımı: Friederici, A. D. (2017). Language in our brain: The origins of a uniquely human capacity. MIT Press. , 2020, Dilbilim Araştırmaları Dergisi.

[3]  Stefan L. Frank,et al.  Comparing Transformers and RNNs on predicting human sentence processing data , 2020, ArXiv.

[4]  Evelina Fedorenko,et al.  No evidence for differences among language regions in their temporal receptive windows , 2020, NeuroImage.

[5]  Christos H. Papadimitriou,et al.  Brain computation by assemblies of neurons , 2019, Proceedings of the National Academy of Sciences.

[6]  Liina Pylkkänen,et al.  Neural basis of basic composition: what we have learned from the red–boat studies and their extensions , 2019, Philosophical Transactions of the Royal Society B.

[7]  G. Buzsáki.  The Brain from Inside Out , 2019 .

[8]  Stefan Frank,et al.  The interaction between structure and meaning in sentence comprehension: Recurrent neural networks and reading times , 2019, CogSci.

[9]  Padraic Monaghan,et al.  Neural network models of language acquisition and processing , 2019 .

[10]  Rafael Yuste,et al.  Triggering visually-guided behavior by holographic activation of 1 pattern completion neurons in cortical ensembles 2 3 , 2018 .

[11]  John Hale,et al.  Finding syntax in human encephalography with beam search , 2018, ACL.

[12]  H. Eichenbaum.  Barlow versus Hebb: When is it time to abandon the notion of feature detectors and adopt the cell assembly as the unit of cognition? , 2017, Neuroscience Letters.

[13]  A. Friederici.  Language in Our Brain: The Origins of a Uniquely Human Capacity , 2017 .

[14]  Friedemann Pulvermüller,et al.  Neurocomputational Consequences of Evolutionary Connectivity Changes in Perisylvian Language Cortex , 2017, The Journal of Neuroscience.

[15]  D. Poeppel,et al.  Cortical Tracking of Hierarchical Linguistic Structures in Connected Speech , 2015, Nature Neuroscience.

[16]  Angela D. Friederici,et al.  Merge in the Human Brain: A Sub-Region Based Functional Investigation in the Left Pars Opercularis , 2015, Front. Psychol..

[17]  Gustavo Deco,et al.  Networks for memory, perception, and decision-making, and beyond to how the syntax for language might be implemented in the brain , 2015, Brain Research.

[18]  Steven M Frankland,et al.  An architecture for encoding sentence meaning in left mid-superior temporal cortex , 2015, Proceedings of the National Academy of Sciences.

[19]  R. Yuste,et al.  Visual stimuli recruit intrinsically generated cortical ensembles , 2014, Proceedings of the National Academy of Sciences.

[20]  S. Thompson-Schill,et al.  Reworking the language network , 2014, Trends in Cognitive Sciences.

[21]  Frank Keller,et al.  Incremental, Predictive Parsing with Psycholinguistically Motivated Tree-Adjoining Grammar , 2013, CL.

[22]  Peter Ford Dominey,et al.  Real-Time Parallel Processing of Grammatical Structure in the Fronto-Striatal System: A Recurrent Network Simulation Study Using Reservoir Computing , 2013, PloS one.

[23]  Marcel Bastiaansen,et al.  Information Structure Influences Depth of Syntactic Processing: Event-Related Potential Evidence for the Chomsky Illusion , 2012, PloS one.

[24]  Frank Keller,et al.  Cognitively Plausible Models of Human Language Processing , 2010, ACL.

[25]  Frank Keller,et al.  A Computational Model of Prediction in Human Parsing: Unifying Locality and Surprisal Effects , 2009 .

[26]  Frank Keller,et al.  Data from eye-tracking corpora as evidence for theories of syntactic processing complexity , 2008, Cognition.

[27]  Frank Keller,et al.  A Psycholinguistically Motivated Version of TAG , 2008, TAG.

[28]  R. Levy.  Expectation-based syntactic comprehension , 2008, Cognition.

[29]  Fred Karlsson,et al.  Constraints on multiple center-embedding of clauses , 2007 .

[30]  Richard L. Lewis,et al.  An Activation-Based Model of Sentence Processing as Skilled Memory Retrieval , 2005, Cogn. Sci..

[31]  K. Harris.  Neural signatures of cell assembly organization , 2005, Nature Reviews Neuroscience.

[32]  Edward Gibson,et al.  Consequences of the Serial Nature of Linguistic Input for Sentenial Complexity , 2005, Cogn. Sci..

[33]  John Hale,et al.  A Probabilistic Earley Parser as a Psycholinguistic Model , 2001, NAACL.

[34]  M. Aminoff.  Principles of Neural Science. 4th edition , 2001 .

[35]  Daniel Jurafsky,et al.  A Probabilistic Model of Lexical and Syntactic Access and Disambiguation , 1996, Cogn. Sci..

[36]  J. Knott.  The organization of behavior: A neuropsychological theory , 1951 .