Models of Innate Neural Attractors and Their Applications for Neural Information Processing

In this work we reveal and explore a new class of attractor neural networks, based on inborn connections provided by model molecular markers, the molecular marker based attractor neural networks (MMBANN). Each set of markers has a metric, which is used to make connections between neurons containing the markers. We have explored conditions for the existence of attractor states, critical relations between their parameters and the spectrum of single neuron models, which can implement the MMBANN. Besides, we describe functional models (perceptron and SOM), which obtain significant advantages over the traditional implementation of these models, while using MMBANN. In particular, a perceptron, based on MMBANN, gets specificity gain in orders of error probabilities values, MMBANN SOM obtains real neurophysiological meaning, the number of possible grandma cells increases 1000-fold with MMBANN. MMBANN have sets of attractor states, which can serve as finite grids for representation of variables in computations. These grids may show dimensions of d = 0, 1, 2,…. We work with static and dynamic attractor neural networks of the dimensions d = 0 and 1. We also argue that the number of dimensions which can be represented by attractors of activities of neural networks with the number of elements N = 104 does not exceed 8.

[1]  A. A. Samarskii,et al.  Numerical Methods for Grid Equations , 2018 .

[2]  Stephen Grossberg,et al.  Coordinated learning of grid cell and place cell spatial and temporal properties: multiple scales, attention and oscillations , 2013, Philosophical Transactions of the Royal Society B: Biological Sciences.

[3]  K. Harris,et al.  Cortical connectivity and sensory coding , 2013, Nature.

[4]  К.П. Соловьева,et al.  Self-Organized Maps on Continuous Bump Attractors , 2013 .

[5]  S. Grossberg.  Coordinated Learning Of Grid Cell And Place Cell Spatial And Temporal Properties: Multiple Scales, Attention, And Oscillations , 2013 .

[6]  C. Koch,et al.  Brain cells for grandmother. , 2013, Scientific American.

[7]  W. Denk,et al.  Staining and embedding the whole mouse brain for electron microscopy , 2012, Nature Methods.

[8]  Hassana K. Oyibo,et al.  Sequencing the Connectome , 2012, PLoS biology.

[9]  J. Knierim,et al.  Attractor dynamics of spatially correlated neural activity in the limbic system. , 2012, Annual review of neuroscience.

[10]  Thomas K. Berger,et al.  A synaptic organizing principle for cortical neuronal groups , 2011, Proceedings of the National Academy of Sciences.

[11]  W. L. Dunin-Barkowski,et al.  Prognosis of dynamical systems behavior based on cerebellar-type neural technologies , 2011, Optical Memory and Neural Networks.

[12]  Witali L. Dunin-Barkowski,et al.  L-plotting - A method for visual analysis of physiological experimental and modeling multi-component data , 2010, Neurocomputing.

[13]  James S. Albus,et al.  Reverse Engineering the Brain , 2010, AAAI Fall Symposium: Biologically Inspired Cognitive Architectures.

[14]  Sandro Romani,et al.  Continuous Attractors with Morphed/Correlated Maps , 2010, PLoS Comput. Biol..

[15]  John J Hopfield,et al.  Neurodynamics of mental exploration , 2009, Proceedings of the National Academy of Sciences.

[16]  A. Treves,et al.  Hippocampal remapping and grid realignment in entorhinal cortex , 2007, Nature.

[17]  Daniel L Adams,et al.  The cortical column: a structure without a function , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[18]  E. Rolls,et al.  Self-organizing continuous attractor networks and path integration: two-dimensional models of place cells , 2002, Network.

[19]  Witali L. Dunin-Barkowski,et al.  Hebb-Hopfield neural networks based on one-dimensional sets of neuron states , 1995, Neural Processing Letters.

[20]  E. Gardner.  The space of interactions in neural network models , 1988 .

[21]  V. L. Dunin-Barkovskii,et al.  Multineuronal structures: theory and experiment. , 1986 .

[22]  Dunin-Barkovskiĭ Vl,et al.  Configuration generators of neuronal rhythm , 1984 .

[23]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[24]  S. Amari.  Dynamics of pattern formation in lateral-inhibition type neural fields , 1977, Biological Cybernetics.

[25]  D Marr,et al.  Simple memory: a theory for archicortex. , 1971, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[26]  Dunin-Barkovskiĭ Vl,et al.  Some properties of a group of neurons working in parallel. I. Neuron pool without connections , 1971 .

[27]  G S Brindley,et al.  Nerve net models of plausible size that perform many simple learning tasks , 1969, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[28]  D. Marr.  A theory of cerebellar cortex , 1969, The Journal of physiology.

[29]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[30]  A ROSENBLUETH,et al.  The mathematical formulation of the problem of conduction of impulses in a network of connected excitable elements, specifically in cardiac muscle. , 1946, Archivos del Instituto de Cardiologia de Mexico.

[31]  I. Pavlov,et al.  Conditioned reflexes: An investigation of the physiological activity of the cerebral cortex. , 1929, Annals of neurosciences.

[32]  A. T. Mathers,et al.  Conditioned Reflexes. An Investigation of the Physiological Activity of the Cerebral Cortex , 1927 .

[33]  伊藤 正男.  The cerebellum : brain for an implicit self , 2012 .

[34]  Witali L. Dunin-Barkowski,et al.  Data Formats in Multineuronal Systems and Brain Reverse Engineering , 2011, BICA.

[35]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.