The necessity of connection structures in neural models of variable binding

In his review of neural binding problems, Feldman (Cogn Neurodyn 7:1–11, 2013) addressed two types of models as solutions of (novel) variable binding. The one type uses labels such as phase synchrony of activation. The other (‘connectivity based’) type uses dedicated connections structures to achieve novel variable binding. Feldman argued that label (synchrony) based models are the only possible candidates to handle novel variable binding, whereas connectivity based models lack the flexibility required for that. We argue and illustrate that Feldman’s analysis is incorrect. Contrary to his conclusion, connectivity based models are the only viable candidates for models of novel variable binding because they are the only type of models that can produce behavior. We will show that the label (synchrony) based models analyzed by Feldman are in fact examples of connectivity based models. Feldman’s analysis that novel variable binding can be achieved without existing connection structures seems to result from analyzing the binding problem in a wrong frame of reference, in particular in an outside instead of the required inside frame of reference. Connectivity based models can be models of novel variable binding when they possess a connection structure that resembles a small-world network, as found in the brain. We will illustrate binding with this type of model with episode binding and the binding of words, including novel words, in sentence structures.

[1]  P. Kuhl Early language acquisition: cracking the speech code , 2004, Nature Reviews Neuroscience.

[2]  E. Kandel The Molecular Biology of Memory Storage: A Dialog Between Genes and Synapses , 2004, Bioscience reports.

[3]  Leonidas A A Doumas,et al.  A theory of the discovery and predication of relational concepts. , 2008, Psychological review.

[4]  K. Holyoak,et al.  A neurocomputational system for relational reasoning , 2012, Trends in Cognitive Sciences.

[5]  S. Pinker The Language Instinct , 1994 .

[6]  Frank van der Velde,et al.  Learning of control in a neural architecture of grounded language processing , 2010, Cognitive Systems Research.

[7]  L. Squire,et al.  The cognitive neuroscience of human memory since H.M. , 2011, Annual review of neuroscience.

[8]  L. Shastri,et al.  From simple associations to systematic reasoning: A connectionist representation of rules, variables and dynamic bindings using temporal synchrony , 1993, Behavioral and Brain Sciences.

[9]  Pieter R. Roelfsema,et al.  The Brain's Router: A Cortical Network Model of Serial Processing in the Primate Brain , 2010, PLoS Comput. Biol..

[10]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[11]  Z. Harris,et al.  Foundations of Language , 1940 .

[12]  Lokendra Shastri,et al.  Multiple instantiation and rule mediation in SHRUTI , 2004, Connect. Sci..

[13]  Jerome Feldman,et al.  The neural binding problem(s) , 2013, Cognitive Neurodynamics.

[14]  Chunguang Li,et al.  Fast and robust image segmentation by small-world neural oscillator networks , 2011, Cognitive Neurodynamics.

[15]  K. Holyoak,et al.  A symbolic-connectionist theory of relational inference and generalization. , 2003, Psychological review.

[16]  F. van der Velde,et al.  Neural blackboard architectures of combinatorial structures in cognition , 2006, Behavioral and Brain Sciences.

[17]  R. O’Reilly,et al.  Modeling hippocampal and neocortical contributions to recognition memory: a complementary-learning-systems approach. , 2003, Psychological review.

[18]  K. Schleifer,et al.  Targeted enhancement of cortical-hippocampal brain networks and associative memory , 2014 .

[19]  Bernard J. Baars,et al.  Global Workspace Dynamics: Cortical “Binding and Propagation” Enables Conscious Contents , 2013, Front. Psychol..

[20]  Moshe Abeles,et al.  Synfire chains , 2009, Scholarpedia.

[21]  R. Quiroga Concept cells: the building blocks of declarative memory functions , 2012, Nature Reviews Neuroscience.

[22]  S. Dehaene,et al.  Cortical representation of the constituent structure of sentences , 2011, Proceedings of the National Academy of Sciences.

[23]  Gadi Pinkas,et al.  A Dynamic Binding Mechanism for Retrieving and Unifying Complex Predicate-Logic Knowledge , 2012, ICANN.

[24]  Frank van der Velde,et al.  From neural dynamics to true combinatorial structures , 2006, Behavioral and Brain Sciences.

[25]  Garrett Swan,et al.  The binding pool: A model of shared neural resources for distinct items in visual working memory , 2014, Attention, perception & psychophysics.