Assembly pointers for variable binding in networks of spiking neurons

We propose a model for binding of variables such as the thematic role of a word in a sentence or episode (e.g., agent or patient), to concrete fillers (e.g., a word or concept). Our model is based on recent experimental data about corresponding processes in the human brain. One source of information are electrode recordings from the human brain, which suggest that concepts are represented in the medial temporal lobe (MTL) through sparse sets of neurons (assemblies). Another source of information are fMRI recordings from the human brain, which suggest that subregions of the temporal cortex are dedicated to the representation of specific roles (e.g., subject or object) of concepts in a sentence or visually presented episode. We propose that quickly recruited assemblies of neurons in these subregions act as pointers to previously created assemblies that represent concepts. We provide a proof of principle that the resulting model for binding through assembly pointers can be implemented in networks of spiking neurons, and supports basic operations of brain computations, such as structured information retrieval and copying of information. We also show that salient features of fMRI data on neural activity during structured information retrieval can be reproduced by the proposed model.

[1]  Jonathan D. Cohen,et al.  Indirection and symbol-like processing in the prefrontal cortex and basal ganglia , 2013, Proceedings of the National Academy of Sciences.

[2]  S. Rumpel,et al.  Discrete Neocortical Dynamics Predict Behavioral Categorization of Sounds , 2012, Neuron.

[3]  Angela D. Friederici,et al.  Grounding language processing on basic neurophysiological principles , 2015, Trends in Cognitive Sciences.

[4]  Andreas Lüthi,et al.  Disinhibition, a Circuit Mechanism for Associative Learning and Memory , 2015, Neuron.

[5]  Trevor Bekolay,et al.  A Large-Scale Model of the Functioning Brain , 2012, Science.

[6]  I. Fried,et al.  Rapid Encoding of New Memories by Individual Neurons in the Human Brain , 2015, Neuron.

[7]  John E. Kelly,et al.  Smart Machines: IBM's Watson and the Era of Cognitive Computing , 2013 .

[8]  Michael P Stryker,et al.  A cortical disinhibitory circuit for enhancing adult plasticity , 2015, eLife.

[9]  M. Wibral,et al.  Untangling cross-frequency coupling in neuroscience , 2014, Current Opinion in Neurobiology.

[10]  Tony A. Plate,et al.  Holographic reduced representations , 1995, IEEE Trans. Neural Networks.

[11]  G. Shepherd,et al.  The neocortical circuit: themes and variations , 2015, Nature Neuroscience.

[12]  Stanislas Dehaene,et al.  A neuronal device for the control of multi-step computations , 2013, 1312.6660.

[13]  Jing Wang,et al.  Identifying thematic roles from neural representations measured by functional magnetic resonance imaging , 2016, Cognitive neuropsychology.

[14]  J. Seamans,et al.  Default activity patterns at the neocortical microcircuit level , 2012, Front. Integr. Neurosci..

[15]  D. Kullmann,et al.  Plasticity of Inhibition , 2012, Neuron.

[16]  G. Marcus The Algebraic Mind: Integrating Connectionism and Cognitive Science , 2001 .

[17]  Steven M Frankland,et al.  An architecture for encoding sentence meaning in left mid-superior temporal cortex , 2015, Proceedings of the National Academy of Sciences.

[18]  R. Quiroga Neuronal codes for visual perception and memory , 2016, Neuropsychologia.

[19]  F. van der Velde,et al.  Neural blackboard architectures of combinatorial structures in cognition , 2006, Behavioral and Brain Sciences.

[20]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[21]  Markus Siegel,et al.  Phase-dependent neuronal coding of objects in short-term memory , 2009, Proceedings of the National Academy of Sciences.

[22]  Ulf Ziemann,et al.  Augmenting Plasticity Induction in Human Motor Cortex by Disinhibition Stimulation. , 2016, Cerebral cortex.

[23]  György Buzsáki,et al.  Neural Syntax: Cell Assemblies, Synapsembles, and Readers , 2010, Neuron.

[24]  Pico Caroni,et al.  Inhibitory microcircuit modules in hippocampal learning , 2015, Current Opinion in Neurobiology.

[25]  Nicolas Brunel,et al.  Modulation of Network Excitability by Persistent Activity: How Working Memory Affects the Response to Incoming Stimuli , 2015, PLoS Comput. Biol..

[26]  M. Carandini,et al.  Inhibition dominates sensory responses in awake cortex , 2012, Nature.

[27]  C. Pfeffer,et al.  Inhibitory Neurons: Vip Cells Hit the Brake on Inhibition , 2014, Current Biology.

[28]  C. Schreiner,et al.  Synaptic plasticity as a cortical coding scheme , 2015, Current Opinion in Neurobiology.

[29]  Wolfgang Maass,et al.  STDP enables spiking neurons to detect hidden causes of their inputs , 2009, NIPS.

[30]  Henry Kennedy,et al.  Brain structure and dynamics across scales: in search of rules , 2016, Current Opinion in Neurobiology.