Sequential configuration model for firing patterns in local neural networks

This paper presents a sequential configuration model to represent the coordinated firing patterns of memory traces in groups of neurons in local networks. Computer simulations are used to study the dynamic properties of memory traces selectively retrieved from networks in which multiple memory traces have been embedded according to the sequential configuration model. Distinct memory traces which utilize the same neurons, but differ only in temporal sequencing are selectively retrievable. Firing patterns of constituent neurons of retrieved memory traces exhibit the main properties of neurons observed in multi microelectrode recordings. The paper shows how to adjust relative synaptic weightings so as to control the disruptive influences of cross-talk in multipy-embedded networks. The theoretical distinction between (primarily anatomical) beds and (primarily physiological) realizations underlines the fundamentally stochastic nature of network firing patterns, and allows the definition of 4 degrees of clarity of retrieved memory traces.

[1]  E R John,et al.  Switchboard versus statistical theories of learning and memory. , 1972, Science.

[2]  George L. Gerstein,et al.  Identification of functionally related neural assemblies , 1978, Brain Research.

[3]  Shun-ichi Amari,et al.  Characteristics of sparsely encoded associative memory , 1989, Neural Networks.

[4]  R. F. Thompson,et al.  The search for the engram. , 1976, The American psychologist.

[5]  Günther Palm,et al.  Local rules for synaptic modification in neural networks , 1993 .

[6]  J. Szentágothai.  The ‘module-concept’ in cerebral cortex architecture , 1975, Brain Research.

[7]  J. Krüger,et al.  Simultaneous recording with 30 microelectrodes in monkey visual cortex , 2004, Experimental Brain Research.

[8]  Chapter XII How Useful are Associative Memories , 1982 .

[9]  M. Abeles,et al.  Neuronal activities related to higher brain functions-theoretical and experimental implications , 1989, IEEE Transactions on Biomedical Engineering.

[10]  Kunihiko Fukushima,et al.  Cognitron: A self-organizing multilayered neural network , 1975, Biological Cybernetics.

[11]  Günther Palm.  Rules for synaptic changes and their relevance for the storage of information in the brain , 1982 .

[12]  George L. Gerstein,et al.  Design of a laboratory for multineuron studies , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[13]  Perambur S. Neelakanta,et al.  Langevin machine: a neural network based on stochastically justifiable sigmoidal function , 1991, Biological Cybernetics.

[14]  John H. Holland,et al.  Tests on a cell assembly theory of the action of the brain, using a large digital computer , 1956, IRE Trans. Inf. Theory.

[15]  Professor Moshe Abeles,et al.  Local Cortical Circuits , 1982, Studies of Brain Function.

[16]  J. Szentágothai.  The modular architectonic principle of neural centers. , 1983, Reviews of physiology, biochemistry and pharmacology.

[17]  M. Brazier,et al.  Architectonics of the cerebral cortex , 1978 .

[18]  K. Lashley,et al.  The neuropsychology of Lashley , 1960 .

[19]  W. A. Clark,et al.  Simulation of self-organizing systems by digital computer , 1954, Trans. IRE Prof. Group Inf. Theory.

[20]  J. Eccles.  The modular operation of the cerebral neocortex considered as the material basis of mental events , 1981, Neuroscience.

[21]  G M Edelman,et al.  Selective networks capable of representative transformations, limited generalizations, and associative memory. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[22]  G. Palm,et al.  On associative memory , 2004, Biological Cybernetics.

[23]  Karl H. Pribram,et al.  The Languages of the Brain , 2002 .

[24]  G. Palm,et al.  Towards a theory of cell assemblies , 2004, Biological Cybernetics.

[25]  A. Rapoport.  “Ignition” phenomena in random nets , 1952 .

[26]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[27]  Teuvo Kohonen,et al.  Self-organization and associative memory: 3rd edition , 1989 .

[28]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[29]  G. Palm.  On the storage capacity of an associative memory with randomly distributed storage elements , 2004, Biological Cybernetics.

[30]  L. Kubie.  A THEORETICAL APPLICATION TO SOME NEUROLOGICAL PROBLEMS OF THE PROPERTIES OF EXCITATION WAVES WHICH MOVE IN CLOSED CIRCUITS , 1930 .

[31]  S. Amari.  Topographic organization of nerve fields , 1979, Neuroscience Letters.

[32]  M. Abeles,et al.  Multispike train analysis , 1977, Proceedings of the IEEE.

[33]  Teuvo Kohonen,et al.  Correlation Matrix Memories , 1972, IEEE Transactions on Computers.

[34]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[35]  James L. McClelland,et al.  Open Questions About Computation in Cerebral Cortex , 1987 .

[36]  A. Aertsen,et al.  Representation of cooperative firing activity among simultaneously recorded neurons. , 1985, Journal of neurophysiology.

[37]  S. Kaplan.  The Physiology of Thought , 1950 .

[38]  D. Gabor.  Associative holographic memories , 1969 .

[39]  J. Krüger.  Simultaneous individual recordings from many cerebral neurons: techniques and results. , 1983, Reviews of physiology, biochemistry and pharmacology.

[40]  George L. Gerstein,et al.  Cross-talk theory of memory capacity in neural networks , 1991, Biological Cybernetics.

[41]  V. Mountcastle.  Modality and topographic properties of single neurons of cat's somatic sensory cortex. , 1957, Journal of neurophysiology.

[42]  Santosh S. Venkatesh,et al.  The capacity of the Hopfield associative memory , 1987, IEEE Trans. Inf. Theory.

[43]  Ronald J. MacGregor,et al.  Neural and brain modeling , 1987 .

[44]  A. Aertsen,et al.  Neuronal assemblies , 1989, IEEE Transactions on Biomedical Engineering.