Memorization and Association on a Realistic Neural Model

A central open question of computational neuroscience is to identify the data structures and algorithms that are used in mammalian cortex to support successive acts of the basic cognitive tasks of memorization and association. This letter addresses the simultaneous challenges of realizing these two distinct tasks with the same data structure, and doing so while respecting the following four basic quantitative parameters of cortex: the neuron number, the synapse number, the synapse strengths, and the switching times. Previous work has not succeeded in reconciling these opposing constraints, the low values of synapse strengths that are typically observed experimentally having contributed a particular obstacle. In this article, we describe a computational scheme that supports both memory formation and association and is feasible on networks of model neurons that respect the widely observed values of the four quantitative parameters. Our scheme allows for both disjoint and shared representations. The algorithms are simple, and in one version both memorization and association require just one step of vicinal or neighborly influence. The issues of interference among the different circuits that are established, of robustness to noise, and of the stability of the hierarchical memorization process are addressed. A calculus therefore is implied for analyzing the capabilities of particular neural systems and subsystems, in terms of their basic numerical parameters.

[1]  R. L. Beurle Properties of a mass of cells capable of regenerating pulses , 1956, Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences.

[2]  J. Griffith On the stability of brain-like structures. , 1963, Biophysical journal.

[3]  Irene A. Stegun,et al.  Handbook of Mathematical Functions. , 1966 .

[4]  Stephen A. Cook,et al.  The complexity of theorem-proving procedures , 1971, STOC.

[5]  J. S. Griffith,et al.  Mathematical neurobiology: An introduction to the mathematics of the nervous system , 1971 .

[6]  V. Braitenberg Cell Assemblies in the Cerebral Cortex , 1978 .

[7]  Roland Heim,et al.  Theoretical Approaches to Complex Systems , 1978 .

[8]  Leslie G. Valiant,et al.  Fast probabilistic algorithms for hamiltonian circuits and matchings , 1977, STOC '77.

[9]  M. Lévesque Perception , 1986, The Yale Journal of Biology and Medicine.

[10]  Leslie G. Valiant,et al.  Functionality in neural nets , 1988, COLT '88.

[11]  Jerome A. Feldman,et al.  Connectionist Models and Their Properties , 1982, Cogn. Sci..

[12]  Moshe Abeles,et al.  Corticonics: Neural Circuits of Cerebral Cortex , 1991 .

[13]  J. Deuchars,et al.  Large, deep layer pyramid-pyramid single axon EPSPs in slices of rat motor cortex display paired pulse and frequency-dependent depression, mediated presynaptically and self-facilitation, mediated postsynaptically. , 1993, Journal of neurophysiology.

[14]  L. Shastri,et al.  From simple associations to systematic reasoning: A connectionist representation of rules, variables and dynamic bindings using temporal synchrony , 1993, Behavioral and Brain Sciences.

[15]  Leslie G. Valiant,et al.  Circuits of the mind , 1994 .

[16]  H. Markram,et al.  Redistribution of synaptic efficacy between neocortical pyramidal neurons , 1996, Nature.

[17]  H. Markram,et al.  Redistribution of synaptic efficacy: A mechanism to generate infinite synaptic input diversity from a homogenous population of neurons without changing absolute synaptic efficacies , 1996, Journal of Physiology - Paris.

[18]  David Willshaw,et al.  Capacity and information efficiency of the associative net , 1997 .

[19]  J. Deuchars,et al.  CA1 pyramidal to basket and bistratified cell EPSPs: dual intracellular recordings in rat hippocampal slices , 1998, The Journal of physiology.

[20]  Prof. Dr. Dr. Valentino Braitenberg,et al.  Cortex: Statistics and Geometry of Neuronal Connectivity , 1998, Springer Berlin Heidelberg.

[21]  G. Carpenter,et al.  Behavioral and Brain Sciences , 1999 .

[22]  Lokendra Shastri,et al.  A computational model of episodic memory formation in the hippocampal system , 2001, Neurocomputing.

[23]  Alexandros V. Gerbessiotis Random Graphs In A Neural Computation Model , 2003, Int. J. Comput. Math..

[24]  Jerome A. Feldman,et al.  Dynamic connections in neural networks , 1990, Biological Cybernetics.

[25]  Alan M. Frieze,et al.  Random graphs , 2006, SODA '06.