From Mirror Neurons to Computational Neurolinguistics

The Mirror System Hypothesis for the evolution of the language-ready brain (e.g., [1, 2]) suggests a path for evolution of brain mechanisms atop the mirror system for grasping, with new processes supporting simple imitation, complex imitation, gesture, pantomime and finally protosign and protospeech. The present talk will briefly summarize the evolutionary story as background for a suggested program of research in neurolinguistics, with modeling challenges at the levels both of schemas and neural networks to make contact with data from psycholinguistics, neurophysiology, and neurology.

[1]  M. Tomasello.  Regularity and Idiomaticity in Grammatical Constructions: The Case of Let Alone , 2003 .

[2]  G. Rizzolatti,et al.  Action recognition in the premotor cortex. , 1996, Brain : a journal of neurology.

[3]  G. Kempen,et al.  Syntactic structure assembly in human parsing: a computational model based on competitive inhibition and a lexicalist grammar , 2000, Cognition.

[4]  Peter Hagoort,et al.  How the brain solves the binding problem for language: a neurocomputational model of syntactic processing , 2003, NeuroImage.

[5]  M. Jeannerod,et al.  Impairment of grasping movements following a bilateral posterior parietal lesion , 1994, Neuropsychologia.

[6]  Y. Grodzinsky,et al.  A blueprint for a brain map of syntax1 , 2004 .

[7]  M. Arbib.  From monkey-like action recognition to human language: An evolutionary framework for neurolinguistics , 2005, Behavioral and Brain Sciences.

[8]  Michael A. Arbib,et al.  Modeling parietal-premotor interactions in primate control of grasping , 1998, Neural Networks.

[9]  Michael A. Arbib,et al.  Action to Language via the Mirror Neuron System: Attention and the minimal subscene , 2006 .

[10]  K. Emmorey.  Language, Cognition, and the Brain: Insights From Sign Language Research , 2001 .

[11]  Adele E. Goldberg.  Constructions: a new theoretical approach to language , 2003, Trends in Cognitive Sciences.

[12]  Michael A. Arbib,et al.  Vision and Action in the Language-Ready Brain: From Mirror Neurons to SemRep , 2007, BVAI.

[13]  Van Valin,et al.  Exploring the Syntax–Semantics Interface: List of abbreviations , 2005 .

[14]  Elisabeth Rieken.  Radical construction grammar: Syntactic theory in typological perspective , 2009 .

[15]  Michael A. Arbib,et al.  A Sentence is to Speech as What is to Action? , 2006, Cortex.

[16]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[18]  Peter Ford Dominey,et al.  A Model of Corticostriatal Plasticity for Learning Oculomotor Associations and Sequences , 1995, Journal of Cognitive Neuroscience.

[19]  M. Arbib.  Aphasia, apraxia and the evolution of the language-ready brain , 2006 .

[20]  David Kemmerer,et al.  Title: Action Verbs, Argument Structure Constructions, and the Mirror Neuron System , 2022 .

[21]  Jean-Arcady Meyer,et al.  Integration of Navigation and Action Selection Functionalities in a Computational Model of Cortico-Basal-Ganglia–Thalamo-Cortical Loops , 2005, Adapt. Behav..

[22]  David Kemmerer,et al.  Selective impairment of knowledge underlying prenominal adjective order: evidence for the autonomy of grammatical semantics , 2000, Journal of Neurolinguistics.

[23]  George Houghton,et al.  Parallel Models of Serial Behaviour: Lashley Revisited , 1995 .

[24]  G. Rizzolatti,et al.  Parietal Lobe: From Action Organization to Intention Understanding , 2005, Science.

[25]  Michael A. Arbib,et al.  Perceptual Structures and Distributed Motor Control , 1981 .

[26]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[27]  Bruce A. Draper,et al.  The schema system , 1988, International Journal of Computer Vision.

[28]  Jonathan D. Cohen,et al.  Conflict monitoring and anterior cingulate cortex: an update , 2004, Trends in Cognitive Sciences.

[29]  Luc Steels,et al.  Hierarchy in Fluid Construction Grammars , 2005, KI.

[30]  T. Shallice,et al.  CONTENTION SCHEDULING AND THE CONTROL OF ROUTINE ACTIVITIES , 2000, Cognitive neuropsychology.

[31]  Benjamin K. Bergen,et al.  Embodied Construction Grammar in Simulation-Based Language Understanding , 2003 .

[32]  Michael A. Arbib,et al.  Extending the mirror neuron system model, II: what did I just do? A new role for mirror neurons , 2010, Biological Cybernetics.

[33]  P. Redgrave,et al.  Testing computational hypotheses of brain systems function: a case study with the basal ganglia , 2004, Network.

[34]  D. Poeppel,et al.  Dorsal and ventral streams: a framework for understanding aspects of the functional anatomy of language , 2004, Cognition.

[35]  Michael A. Arbib,et al.  Describing visual scenes: Towards a neurolinguistics based on construction grammar , 2008, Brain Research.

[36]  Matthias Schlesewsky,et al.  On incremental interpretation: Degrees of meaning accessed during sentence comprehension , 2004 .

[37]  Y. Grodzinsky.  The neurology of syntax: Language use without Broca's area , 2000, Behavioral and Brain Sciences.

[38]  G. Rizzolatti,et al.  Premotor cortex and the recognition of motor actions. , 1996, Brain research. Cognitive brain research.

[39]  J. A. Shafer,et al.  Understanding aphasia. , 1954, Archives of Physical Medicine and Rehabilitation.

[40]  Michael Arbib,et al.  Extending the mirror neuron system model, I. Audible actions and invisible grasps. , 2007, Biological cybernetics.

[41]  A. Wohlschlager,et al.  Action generation and action perception in imitation : An instance of the ideomotor principle , 2003 .

[42]  Scott T. Grafton,et al.  Localization of grasp representations in humans by positron emission tomography , 1996, Experimental Brain Research.

[43]  Michael A. Arbib,et al.  Schema design and implementation of the grasp-related mirror neuron system , 2002, Biological Cybernetics.

[44]  Michael A. Arbib,et al.  Action to Language via the Mirror Neuron System: Neural homologies and the grounding of neurolinguistics , 2006 .

[45]  David Kemmerer,et al.  Grammatically relevant and grammatically irrelevant features of verb meaning can be independently impaired , 2000 .

[46]  David Kemmerer,et al.  Action to Language via the Mirror Neuron System: Action verbs, argument structure constructions, and the mirror neuron system , 2006 .

[47]  Peter Ford Dominey,et al.  When Broca Experiences the Janus Syndrome: an ER-FMRI Study Comparing Sentence Comprehension and Cognitive Sequence Processing , 2006, Cortex.

[48]  C. Büchel,et al.  Broca's area and the language instinct , 2003, Nature Neuroscience.

[49]  M. Arbib,et al.  Language within our grasp , 1998, Trends in Neurosciences.

[50]  B Alstermark,et al.  Integration in descending motor pathways controlling the forelimb in the cat. 9. Differential behavioural defects after spinal cord lesions interrupting defined pathways from higher centres to motoneurones. , 1981, Experimental brain research.

[51]  L. Jakobson,et al.  A neurological dissociation between perceiving objects and grasping them , 1991, Nature.

[52]  Matthew M Botvinick,et al.  Short-term memory for serial order: a recurrent neural network model. , 2006, Psychological review.

[53]  Michael A. Arbib,et al.  The syntactic motor system , 2005 .

[54]  Peter Ford Dominey,et al.  A Neurolinguistic Model of Grammatical Construction Processing , 2006, Journal of Cognitive Neuroscience.

[55]  T Matsuzawa,et al.  Factors influencing imitation of manipulatory actions in chimpanzees (Pan troglodytes). , 1999, Journal of comparative psychology.

[56]  Daniel Bullock,et al.  Learning and production of movement sequences: behavioral, neurophysiological, and modeling perspectives. , 2004, Human movement science.

[57]  William Croft,et al.  Cognitive Linguistics , 2004 .