An Associative Cortical Model of Language Understanding and Action Planning

The brain representations of words and their referent actions and objects appear to be strongly coupled neuronal assemblies distributed over several cortical areas. In this work we describe the implementation of a cell assembly-based model of several visual, language, planning, and motor areas to enable a robot to understand and react to simple spoken commands. The essential idea is that different cortical areas represent different aspects of the same entity, and that the long-range cortico-cortical projections represent hetero-associative memories that translate between these aspects or representations.

[1]  Jeffrey D. Ullman,et al.  Formal languages and their relation to automata , 1969, Addison-Wesley series in computer science and information processing.

[2]  Marvin Minsky,et al.  Computation : finite and infinite machines , 2016 .

[3]  Friedemann Pulvermüller.  Sequence detectors as a basis of grammar in the brain , 2003 .

[4]  G. Palm,et al.  On associative memory , 2004, Biological Cybernetics.

[5]  Friedemann Pulvermüller,et al.  The Neuroscience of Language: On Brain Circuits of Words and Serial Order , 2003 .

[6]  Friedemann Pulverm Uuml,et al.  Words in the brain's language , 1999 .

[7]  Andreas Knoblauch,et al.  Synchronization and pattern separation in spiking associative memories and visual cortical areas , 2004 .

[8]  F. Pulvermüller,et al.  Words in the brain's language , 1999, Behavioral and Brain Sciences.

[9]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[10]  Don R. Hush,et al.  Bounds on the complexity of recurrent neural network implementations of finite state machines , 1993, Neural Networks.

[11]  Gèunther Palm,et al.  Neural Assemblies: An Alternative Approach to Artificial Intelligence , 1982 .

[12]  Alessandro Saffiotti,et al.  Anchoring Symbols to Sensor Data: Preliminary Report , 2000, AAAI/IAAI.

[13]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[14]  Andreas Knoblauch,et al.  Pattern separation and synchronization in spiking associative memories and visual areas , 2001, Neural Networks.

[15]  F. Attneave,et al.  The Organization of Behavior: A Neuropsychological Theory , 1949 .

[16]  G. Palm.  Neural Assemblies , 1982, Studies of Brain Function.

[17]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[18]  G. Palm,et al.  Associating words to visually recognized objects ∗ , 2004 .

[19]  G. Palm,et al.  Integrating object recognition , visual attention , language and action processing on a robot in a neurobiologically plausible associative architecture , 2004 .

[20]  H. C. LONGUET-HIGGINS,et al.  Non-Holographic Associative Memory , 1969, Nature.