From Sensorimotor Sequence to Grammatical Construction: Evidence from Simulation and Neurophysiology

The current research describes a functional trajectory from sensorimotor sequence learning to the learning of grammatical constructions in language. A brief review of the functional neurophysiology of the cortex and basal ganglia will be provided as background for a neural network model of this system in sensorimotor sequence learning. Sequential behavior is then defined in terms of serial, temporal and abstract structure. The resulting neuro-computational framework is demonstrated to account for observed sequence learning behavior. More interestingly, this framework naturally extends to grammatical constructions as form-to-meaning mappings. Predictions from the neuro-computational model concerning parallels in language and cognitive sequence processing are tested against behavioral and neurophysiological observations in humans, resulting in a refinement of the allocation of model functions to subdivisions of Broca's area. From a functional perspective this analysis will provide insight into the relation between the coding structure in human languages, and constraints derived from the underlying neurophysiological computational mechanisms.

[1]  Peter Hagoort,et al.  Electrophysiological Signatures of Visual Lexical Processing: Open-and Closed-Class Words , 1999, Journal of Cognitive Neuroscience.

[2]  Peter Ford Dominey,et al.  Learning to talk about events from narrated video in a construction grammar framework , 2005, Artif. Intell..

[3]  Noam Chomsky,et al.  Aspects of the Theory of Syntax. , 1966 .

[4]  W. Schultz Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioural ecology , 2004, Current Opinion in Neurobiology.

[5]  M. Arbib,et al.  Language within our grasp , 1998, Trends in Neurosciences.

[6]  J. Joseph,et al.  Prefrontal cortex and spatial sequencing in macaque monkey , 2004, Experimental Brain Research.

[7]  M. Nissen,et al.  Attentional requirements of learning: Evidence from performance measures , 1987, Cognitive Psychology.

[8]  J. Werker,et al.  Newborn infants’ sensitivity to perceptual cues to lexical and grammatical words , 1999, Cognition.

[9]  D. Caplan,et al.  Syntactic determinants of sentence comprehension in aphasia , 1985, Cognition.

[10]  J. Michael Verbal behavior. , 1984, Journal of the experimental analysis of behavior.

[11]  F. Chang Symbolically speaking: a connectionist model of sentence production , 2002 .

[12]  F. Plum Handbook of Physiology. , 1960 .

[13]  Peter Ford Dominey,et al.  A Developmental Model of Syntax Acquisition in the Construction Grammar Framework with Cross-Linguistic Validation in English and Japanese , 2004 .

[14]  Fernando J. Pineda,et al.  Recurrent Backpropagation and the Dynamical Approach to Adaptive Neural Computation , 1989, Neural Computation.

[15]  Peter Ford Dominey,et al.  Influences of temporal organization on sequence learning and transfer : Comments on Stadler (1995) and Curran and Keele (1993) , 1998 .

[16]  Peter Ford Dominey,et al.  A Model of Learning Syntactic Comprehension for Natural and Artificial Grammars , 2002 .

[17]  E. Mark Gold,et al.  Language Identification in the Limit , 1967, Inf. Control..

[18]  Luc Steels,et al.  Aibo''s first words. the social learning of language and meaning. Evolution of Communication , 2002 .

[19]  Peter Ford Dominey,et al.  Cognitive sequence processing and syntactic comprehension in schizophrenia , 2000, Neuroreport.

[20]  G. E. Alexander,et al.  Parallel organization of functionally segregated circuits linking basal ganglia and cortex. , 1986, Annual review of neuroscience.

[21]  Peter Ford Dominey,et al.  ERP analysis of cognitive sequencing: a left anterior negativity related to structural transformation processing , 2000, Neuroreport.

[22]  M. Tomasello Constructing a Language: A Usage-Based Theory of Language Acquisition , 2003 .

[23]  Eve V. Clark,et al.  First Language Acquisition , 2002, The Study of Language.

[24]  Peter Ford Dominey,et al.  A shared system for learning serial and temporal structure of sensori-motor sequences? Evidence from simulation and human experiments. , 1998, Brain research. Cognitive brain research.

[25]  Noam Chomsky,et al.  वाक्यविन्यास का सैद्धान्तिक पक्ष = Aspects of the theory of syntax , 1965 .

[26]  Susan Foster-Cohen,et al.  CONSTRUCTING A LANGUAGE: A USAGE-BASED THEORY OF LANGUAGE ACQUISITION , 2004, Studies in Second Language Acquisition.

[27]  R. Jackendoff Foundations of Language: Brain, Meaning, Grammar, Evolution , 2002 .

[28]  J. Leo van Hemmen,et al.  Temporal association , 1991 .

[29]  Peter Ford Dominey Learning Grammatical Constructions in a Miniature Language from Narrated Video Events , 2003 .

[30]  C. W. Greene THE AMERICAN PHYSIOLOGICAL SOCIETY. , 1922, Science.

[31]  Peter Ford Dominey,et al.  Neurological basis of language and sequential cognition: Evidence from simulation, aphasia, and ERP studies , 2003, Brain and Language.

[32]  Ray Jackendoff,et al.  Parallel constraint-based generative theories of language , 1999, Trends in Cognitive Sciences.

[33]  Peter Ford Dominey,et al.  Dissociable Processes for Learning the Surface Structure and Abstract Structure of Sensorimotor Sequences , 1998, Journal of Cognitive Neuroscience.

[34]  Peter Ford Dominey,et al.  Evidence for a Shared Mechanism in Linguistic and Nonlinguistic Sequence Processing ? ERP Recordings of On-Line Function-and Content-Information Integration , 2004 .

[35]  Peter Ford Dominey Complex sensory-motor sequence learning based on recurrent state representation and reinforcement learning , 1995, Biological Cybernetics.

[36]  M. Ullman Contributions of memory circuits to language: the declarative/procedural model , 2004, Cognition.

[37]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[38]  Peter M. Vishton,et al.  Rule learning by seven-month-old infants. , 1999, Science.

[39]  W. Kinzel Physics of Neural Networks , 1990 .

[40]  J. Hurford The neural basis of predicate-argument structure. , 2003, The Behavioral and brain sciences.

[41]  Peter Ford Dominey,et al.  A Model of Corticostriatal Plasticity for Learning Oculomotor Associations and Sequences , 1995, Journal of Cognitive Neuroscience.

[42]  Peter Ford Dominey,et al.  Developmental stages of perception and language acquisition in a perceptually grounded robot , 2005, Cognitive Systems Research.

[43]  P. Calabresi,et al.  Dopaminergic control of synaptic plasticity in the dorsal striatum , 2001, The European journal of neuroscience.

[44]  J. Fuster Prefrontal Cortex , 2018 .

[45]  Leslie G. Ungerleider,et al.  A neural system for human visual working memory. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[46]  Peter Ford Dominey Conceptual grounding in simulation studies of language acquisition , 2000 .

[47]  Barak A. Pearlmutter Gradient calculations for dynamic recurrent neural networks: a survey , 1995, IEEE Trans. Neural Networks.

[48]  P. Tichý Constructions , 1986, Philosophy of Science.

[49]  Peter Ford Dominey,et al.  When Broca Experiences the Janus Syndrome: an ER-FMRI Study Comparing Sentence Comprehension and Cognitive Sequence Processing , 2006, Cortex.

[50]  Z. Harris,et al.  Foundations of language , 1941 .

[51]  Noam Chomsky Review of B.F. Skinner, Verbal Behavior , 1959 .

[52]  Peter Ford Dominey,et al.  Neural network processing of natural language: I. Sensitivity to serial, temporal and abstract structure of language in the infant , 2000 .

[53]  Julian M. Pine,et al.  Constructing a Language: A Usage-Based Theory of Language Acquisition. , 2004 .

[54]  Brian MacWhinney,et al.  Functional constraints on sentence processing: A cross-linguistic study , 1982, Cognition.

[55]  Risto Miikkulainen Subsymbolic Case-Role Analysis of Sentences with Embedded Clauses , 1993 .

[56]  Peter Ford Dominey,et al.  Temporal Processing for Syntax Acquisition: A simulation study , 2003 .

[57]  Noam Chomsky,et al.  A Review of B. F. Skinner's Verbal Behavior , 1980 .