Language models based on Hebbian cell assemblies

This paper demonstrates how associative neural networks as standard models for Hebbian cell assemblies can be extended to implement language processes in large-scale brain simulations. To this end the classical auto- and hetero-associative paradigms of attractor nets and synfire chains (SFCs) are combined and complemented by conditioned associations as a third principle which allows for the implementation of complex graph-like transition structures between assemblies. We show example simulations of a multiple area network for object-naming, which categorises objects in a visual hierarchy and generates different specific syntactic motor sequences ("words") in response. The formation of cell assemblies due to ongoing plasticity in a multiple area network for word learning is studied afterwards. Simulations show how assemblies can form by means of percolating activity across auditory and motor-related language areas, a process supported by rhythmic, synchronized propagating waves through the network. Simulations further reproduce differences in own EEG&MEG experiments between responses to word- versus non-word stimuli in human subjects.

[1]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[2]  E. Bienenstock A model of neocortex , 1995 .

[3]  T. Wiesel,et al.  Clustered intrinsic connections in cat visual cortex , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[4]  A. Braun,et al.  Temporal dissociation of early lexical access and articulation using a delayed naming task--an FMRI study. , 2006, Cerebral cortex.

[5]  Daniel Lehmann,et al.  Modeling Compositionality by Dynamic Binding of Synfire Chains , 2004, Journal of Computational Neuroscience.

[6]  Prof. Dr. Valentino Braitenberg,et al.  Anatomy of the Cortex , 1991, Studies of Brain Function.

[7]  Eugene M. Izhikevich,et al.  Relating STDP to BCM , 2003, Neural Computation.

[8]  R. Malach,et al.  Cortical hierarchy reflected in the organization of intrinsic connections in macaque monkey visual cortex , 1993, The Journal of comparative neurology.

[9]  Thomas Wennekers,et al.  Dynamics of spatio-temporal patterns in associative networks of spiking neurons , 2000, Neurocomputing.

[10]  Matthew L. Shapiro,et al.  Simulating Hebb cell assemblies: the necessity for partitioned dendritic trees and a post-not-pre LTD rule , 1993 .

[11]  E. Vaadia,et al.  Spatiotemporal firing patterns in the frontal cortex of behaving monkeys. , 1993, Journal of neurophysiology.

[12]  J. Feldman,et al.  Embodied meaning in a neural theory of language , 2004, Brain and Language.

[13]  E. Rolls,et al.  Attention and working memory: a dynamical model of neuronal activity in the prefrontal cortex , 2003, The European journal of neuroscience.

[14]  V. Braitenberg Cell Assemblies in the Cerebral Cortex , 1978 .

[15]  Karl J. Friston,et al.  Neural modeling and functional brain imaging: an overview , 2000, Neural Networks.

[16]  Friedemann Pulvermüller,et al.  A cell assembly model of language , 1991 .

[17]  Roland Heim,et al.  Theoretical Approaches to Complex Systems , 1978 .

[18]  Thomas Wennekers,et al.  Associative memory in networks of spiking neurons , 2001, Neural Networks.

[19]  Michael A. Arbib,et al.  Synthetic brain imaging: grasping, mirror neurons and imitation , 2000, Neural Networks.

[20]  L. Abbott,et al.  Cascade Models of Synaptically Stored Memories , 2005, Neuron.

[21]  J. Fuster Upper processing stages of the perception–action cycle , 2004, Trends in Cognitive Sciences.

[22]  Friedemann Pulverm Uuml,et al.  Words in the brain's language , 1999 .

[23]  Risto Näätänen,et al.  Word-specific cortical activity as revealed by the mismatch negativity. , 2004, Psychophysiology.

[24]  D. O. Hebb,et al.  The organization of behavior , 1988 .

[25]  Nicolas Brunel,et al.  Dynamics of the Firing Probability of Noisy Integrate-and-Fire Neurons , 2002, Neural Computation.

[26]  Y. Dan,et al.  Spike-timing-dependent synaptic plasticity depends on dendritic location , 2005, Nature.

[27]  Yuji Ikegaya,et al.  Synfire Chains and Cortical Songs: Temporal Modules of Cortical Activity , 2004, Science.

[28]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[29]  Kenneth C. Hill,et al.  The genesis of language , 1982 .

[30]  Friedemann Pulvermüller,et al.  Brain mechanisms linking language and action , 2005, Nature Reviews Neuroscience.

[31]  T. Sejnowski,et al.  Storing covariance with nonlinearly interacting neurons , 1977, Journal of mathematical biology.

[32]  Thomas Wennekers,et al.  Synfire chains with conductance-based neurons: internal timing and coordination with timed input , 2005, Neurocomputing.

[33]  Patrick Brézillon,et al.  Lecture Notes in Artificial Intelligence , 1999 .

[34]  F. Pulvermüller,et al.  Words in the brain's language , 1999, Behavioral and Brain Sciences.

[35]  Ad Aertsen,et al.  Editorial: Cell Assemblies , 2003 .

[36]  E. Rolls,et al.  A Neurodynamical cortical model of visual attention and invariant object recognition , 2004, Vision Research.

[37]  Daeyeol Lee,et al.  Activity in prefrontal cortex during dynamic selection of action sequences , 2006, Nature Neuroscience.

[38]  S L Moody,et al.  A Model That Accounts for Activity in Primate Frontal Cortex during a Delayed Matching-to-Sample Task , 1998, The Journal of Neuroscience.

[39]  J. Fuster Prefrontal Cortex , 2018 .

[40]  Günther Palm,et al.  Cell Assemblies, Associative Memory and Temporal Structure in Brain Signals , 2000 .

[41]  F. Pulvermüller,et al.  Language outside the focus of attention: The mismatch negativity as a tool for studying higher cognitive processes , 2006, Progress in Neurobiology.

[42]  E. Koechlin,et al.  Broca's Area and the Hierarchical Organization of Human Behavior , 2006, Neuron.

[43]  Günther Palm,et al.  A neural network model of the cortico-hippocampal interplay and the representation of contexts , 1995, Behavioural Brain Research.

[44]  J. Cowan,et al.  Excitatory and inhibitory interactions in localized populations of model neurons. , 1972, Biophysical journal.

[45]  A. Aertsen,et al.  Neuronal assemblies , 1989, IEEE Transactions on Biomedical Engineering.

[46]  B. Hommel Event files: feature binding in and across perception and action , 2004, Trends in Cognitive Sciences.

[47]  J. Fuster Cortex and mind : unifying cognition , 2003 .

[48]  Friedemann Pulvermüller,et al.  Sequence Detector Networks and Associative Learning of Grammatical Categories , 2005, Biomimetic Neural Learning for Intelligent Robots.

[49]  Gèunther Palm,et al.  Neural Assemblies: An Alternative Approach to Artificial Intelligence , 1982 .

[50]  H. C. LONGUET-HIGGINS,et al.  Non-Holographic Associative Memory , 1969, Nature.

[51]  Adam Prügel-Bennett,et al.  Analysis of synfire chains , 1995 .

[52]  M. Walton,et al.  Action sets and decisions in the medial frontal cortex , 2004, Trends in Cognitive Sciences.

[53]  Florentin Wörgötter,et al.  Temporal Sequence Learning, Prediction, and Control: A Review of Different Models and Their Relation to Biological Mechanisms , 2005, Neural Computation.

[54]  Naftali Tishby,et al.  Cortical activity flips among quasi-stationary states. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[55]  Friedemann Pulvermüller,et al.  A neuronal model of the language cortex , 2007, Neurocomputing.

[56]  D. Amit The Hebbian paradigm reintegrated: Local reverberations as internal representations , 1995, Behavioral and Brain Sciences.