An n-level field theory of biological neural networks

An n-level field theory, based on the concept of “functional interaction”, is proposed for a description of the continuous dynamics of biological neural networks. A “functional interaction” describes the action from one substructure of a network to another at several levels of organization, molecular, synaptic, and neural. Because of the continuous representation of neurons and synapses, which constitute a hierarchical system, it is shown that the property of non-locality leads to a non-local field operator in the field equations. In a hierarchical continuous system, the finite velocity of the functional interaction at the lower level implies non-locality at the higher level. Two other properties of the functional interaction are introduced in the formulation: the non-symmetry between sources and sinks, and the non-uniformity of the medium. Thus, it is shown that: (i) The coupling between topology and geometry can be introduced via two functions, the density of neurons at the neuronal level of organization, and the density-connectivity of synapses between two points of the neural space at the synaptic level of organization. With densities chosen as Dirac functions at regularly spaced points, the dynamics of a discrete network becomes a particular case of the n-level field theory. (ii) The dynamics at each of the molecular and synaptic lower level are introduced, at the next upper level, both in the source and in the non-local interaction of the field to integrate the dynamics at the neural level. (iii) New learning rules are deduced from the structure of the field equations: Hebbian rules result from strictly local activation; non-Hebbian rules result from homosynaptic activation with strict heterosynaptic effects, i.e., when an activated synaptic pathway affects the efficacy of a non-activated one; non-Hebbian rules and/or non-linearities result from the structure of the interaction operator and/or the internal biochemical kinetics.

[1]  F. Attneave,et al.  The Organization of Behavior: A Neuropsychological Theory , 1949 .

[2]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[3]  R. L. Beurle Properties of a mass of cells capable of regenerating pulses , 1956, Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences.

[4]  J. Griffith A field theory of neural nets: I. Derivation of field equations. , 1963, The Bulletin of mathematical biophysics.

[5]  S. Grossberg Nonlinear difference-differential equations in prediction and learning theory. , 1967, Proceedings of the National Academy of Sciences of the United States of America.

[6]  H. C. LONGUET-HIGGINS,et al.  Holographic Model of Temporal Recall , 1968, Nature.

[7]  D. Marr A theory of cerebellar cortex , 1969, The Journal of physiology.

[8]  J. Albus A Theory of Cerebellar Function , 1971 .

[9]  Teuvo Kohonen,et al.  Correlation Matrix Memories , 1972, IEEE Transactions on Computers.

[10]  J. Cowan,et al.  Excitatory and inhibitory interactions in localized populations of model neurons. , 1972, Biophysical journal.

[11]  Burkhart Fischer,et al.  A neuron field theory: Mathemalical approaches to the problem of large numbers of interacting nerve cells , 1973 .

[12]  J Rinzel,et al.  Branch input resistance and steady attenuation for input to one branch of a dendritic neuron model. , 1973, Biophysical journal.

[13]  G. Lynch,et al.  Heterosynaptic depression: a postsynaptic correlate of long-term potentiation , 1977, Nature.

[14]  T. Sejnowski,et al.  Storing covariance with nonlinearly interacting neurons , 1977, Journal of mathematical biology.

[15]  Teuvo Kohonen,et al.  Associative memory. A system-theoretical approach , 1977 .

[16]  W. Levy,et al.  Synapses as associative memory elements in the hippocampal formation , 1979, Brain Research.

[17]  S. Amari,et al.  Existence and stability of local excitations in homogeneous neural fields , 1979, Journal of mathematical biology.

[18]  A. M. Uttley,et al.  Information transmission in the nervous system , 1979 .

[19]  K. Magleby,et al.  A quantitative description of stimulation-induced changes in transmitter release at the frog neuromuscular junction , 1982, The Journal of general physiology.

[20]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[21]  S. Grossberg Studies of mind and brain : neural principles of learning, perception, development, cognition, and motor control , 1982 .

[22]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[23]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[24]  R. D. Traub,et al.  Computer simulations indicate that electrical field effects contribute to the shape of the epileptiform field potential , 1985, Neuroscience.

[25]  J. Jacquez Compartmental analysis in biology and medicine , 1985 .

[26]  P. Peretto,et al.  Collective Properties of Neural Networks , 1986 .

[27]  S. Kelso,et al.  Hebbian synapses in hippocampus. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[28]  S Dehaene,et al.  Spin glass model of learning by selection. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[29]  Richard F. Thompson The neurobiology of learning and memory. , 1986, Science.

[30]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[31]  J. Byrne,et al.  Single-cell neuronal model for associative learning. , 1987, Journal of neurophysiology.

[32]  Lin-Bao Yang,et al.  Cellular neural networks: theory , 1988 .

[33]  L N Cooper,et al.  Mean-field theory of a neural network. , 1988, Proceedings of the National Academy of Sciences of the United States of America.

[34]  Francis Crick,et al.  The recent excitement about neural networks , 1989, Nature.

[35]  G. Barrionuevo,et al.  Long‐term potentiation in hippocampal CA3 neurons: Tetanized input regulates heterosynaptic efficacy , 1989, Synapse.

[36]  J Demongeot,et al.  Random field and neural information. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[37]  E. W. Kairiss,et al.  Hebbian synapses: biophysical mechanisms and algorithms. , 1990, Annual review of neuroscience.

[38]  G. Barrionuevo,et al.  Heterosynaptic correlates of long-term potentiation induction in hippocampal CA3 neurons , 1990, Neuroscience.

[39]  J Ambros-Ingerson,et al.  Simulation of paleocortex performs hierarchical clustering. , 1990, Science.

[40]  Stephen Grossberg,et al.  The second anniversary of Neural Networks , 1990, Neural Networks.

[41]  T. H. Brown,et al.  Biophysical model of a Hebbian synapse. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[42]  Stephen Grossberg,et al.  ART 3: Hierarchical search using chemical transmitters in self-organizing pattern recognition architectures , 1990, Neural Networks.

[43]  G A Chauvet,et al.  Hierarchical functional organization of formal biological systems: a dynamical approach. I. The increase of complexity by self-association increases the domain of stability of a biological system. , 1993, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[44]  G. Chauvet Hierarchical functional organization of formal biological systems: a dynamical approach. III. The concept of non-locality leads to a field theory describing the dynamics at each level of organization of the (D-FBS) sub-system. , 1993, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[45]  G. Chauvet,et al.  Non-locality in biological systems results from hierarchy , 1993, Journal of mathematical biology.

[46]  Stephen Grossberg Content-addressable memory storage by neural networks: a general model and global Liapunov method , 1993 .