A model of cortical associative memory based on a horizontal network of connected columns.

An attractor network model of cortical associative memory functions has been constructed and simulated. By replacing the single cell as the functional unit by multiple cells in cortical columns connected by long-range fibers, the model is improved in terms of correspondence with cortical connectivity. The connectivity is improved, since the original dense and symmetric connectivity of a standard recurrent network becomes sparse and asymmetric at the cell-to-cell level. Our simulations show that this kind of network, with model neurons of the Hodgkin-Huxley type arranged in columns, can operate as an associative memory in much the same way as previous models having simpler connectivity. The network shows attractor-like behaviour and performs the standard assembly operations despite differences in the dynamics introduced by the more detailed cell model and network structure. Furthermore, the model has become sufficiently detailed to allow evaluation against electrophysiological and anatomical observations. For instance, cell activities comply with experimental findings and reaction times are within biological and psychological ranges. By introducing a scaling model we demonstrate that a network approaching experimentally reported neuron numbers and synaptic distributions also could work like the model studied here.

[1]  T. Wiesel,et al.  Morphology and intracortical projections of functionally characterised neurones in the cat visual cortex , 1979, Nature.

[2]  L C Katz,et al.  Development of local circuits in mammalian visual cortex. , 1992, Annual review of neuroscience.

[3]  H. Tamura,et al.  Development of local horizontal interactions in cat visual cortex studied by cross-correlation analysis. , 1993, Journal of neurophysiology.

[4]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[5]  C. Koch,et al.  Synaptic background activity influences spatiotemporal integration in single pyramidal cells. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Y. Miyashita,et al.  Neuronal correlate of pictorial short-term memory in the primate temporal cortexYasushi Miyashita , 1988, Nature.

[7]  W. Precht The synaptic organization of the brain G.M. Shepherd, Oxford University Press (1975). 364 pp., £3.80 (paperback) , 1976, Neuroscience.

[9]  J. Deuchars,et al.  Temporal and spatial properties of local circuits in neocortex , 1994, Trends in Neurosciences.

[10]  Anders Lansner,et al.  Low Spiking Rates in a Network with Overlapping Assemblies , 1995 .

[11]  C. Koch,et al.  Modeling direction selectivity of simple cells in striate visual cortex within the framework of the canonical microcircuit , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  T. Wiesel,et al.  Relationships between horizontal interactions and functional architecture in cat striate cortex as revealed by cross-correlation analysis , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[13]  M. A Virasoro Categorization in neural networks and prosopagnosia , 1989 .

[14]  J. Lacaille Postsynaptic potentials mediated by excitatory and inhibitory amino acids in interneurons of stratum pyramidale of the CA1 region of rat hippocampal slices in vitro. , 1991, Journal of neurophysiology.

[15]  Y. Miyashita Neuronal correlate of visual associative long-term memory in the primate temporal cortex , 1988, Nature.

[16]  P S Goldman-Rakic,et al.  Functional synergism between putative gamma-aminobutyrate-containing neurons and pyramidal neurons in prefrontal cortex. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[17]  Erik Fransén,et al.  Biophysical simulation of cortical associative memory , 1996 .

[18]  Patricia S. Goldman TOPOGRAPHY OF COGNITION: Parallel Distributed Networks in Primate Association Cortex , 1988 .

[19]  C. Koch,et al.  Recurrent excitation in neocortical circuits , 1995, Science.

[20]  G. Palm,et al.  Density of neurons and synapses in the cerebral cortex of the mouse , 1989, The Journal of comparative neurology.

[21]  Nicolas Brunel,et al.  Dynamics of a recurrent network of spiking neurons before and following learning , 1997 .

[22]  C. Gilbert,et al.  Synaptic physiology of horizontal connections in the cat's visual cortex , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[23]  D. Amit,et al.  Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. , 1997, Cerebral cortex.

[24]  A. Cowey,et al.  Retrograde transport of gamma-amino[3H]butyric acid reveals specific interlaminar connections in the striate cortex of monkey. , 1983, Proceedings of the National Academy of Sciences of the United States of America.

[25]  T. Wiesel,et al.  Targets of horizontal connections in macaque primary visual cortex , 1991, The Journal of comparative neurology.

[26]  D. McCormick,et al.  Comparative electrophysiology of pyramidal and sparsely spiny stellate neurons of the neocortex. , 1985, Journal of neurophysiology.

[27]  Y. Kawaguchi Physiological subgroups of nonpyramidal cells with specific morphological characteristics in layer II/III of rat frontal cortex , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[28]  B. Cartling,et al.  Autonomous neuromodulatory control of associative processes , 1995 .

[29]  Anders Lansner,et al.  A Higher order Bayesian Neural Network with Spiking Units , 1996, Int. J. Neural Syst..

[30]  B. Connors,et al.  Electrophysiological properties of neocortical neurons in vitro. , 1982, Journal of neurophysiology.

[31]  Goldman-Rakic Cellular Basis of Working Memory Review , 2022 .

[32]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[33]  Anders Lansner,et al.  Detailed simulation of large scale neural network models , 1997 .

[34]  M. Wong-Riley,et al.  Entorhinal cortex of the human, monkey, and rat: Metabolic map as revealed by cytochrome oxidase , 1992, The Journal of comparative neurology.

[35]  Hans Liljenström,et al.  A model of cortical associative memory based on Hebbian cell assemblies , 1994 .

[36]  Colin Blakemore,et al.  Patterns of Local Connectivity in the Neocortex , 1993, Neural Computation.

[37]  Ö. Ekeberg,et al.  SWIM — A Simulation Environment for Realistic Neural Network Modeling , 1994 .

[38]  C. Scholfield,et al.  Electrical properties of neurones in the olfactory cortex slice in vitro. , 1978, The Journal of physiology.

[39]  K. Martin,et al.  The Wellcome Prize lecture. From single cells to simple circuits in the cerebral cortex. , 1988, Quarterly journal of experimental physiology.

[40]  S. Grillner,et al.  A computer-based model for realistic simulations of neural networks. II. The segmental network generating locomotor rhythmicity in the lamprey. , 1992 .

[41]  D. Ferster,et al.  An intracellular analysis of geniculo‐cortical connectivity in area 17 of the cat. , 1983, The Journal of physiology.

[42]  M. Weliky,et al.  Functional mapping of horizontal connections in developing ferret visual cortex: experiments and modeling , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[43]  Anders Lansner,et al.  Improving the Realism of Attractor Models By using Cortical Columns as Functional Units , 1995 .

[44]  Örjan Ekeberg,et al.  Reliability and Speed of Recall in an Associative Network , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  J P Changeux,et al.  Chemical signaling in the brain. , 1993, Scientific American.

[46]  P. Goldman-Rakic,et al.  Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. , 1989, Journal of neurophysiology.

[47]  C D Woody,et al.  Electrophysiological characterization of different types of neurons recorded in vivo in the motor cortex of the cat. II. Membrane parameters, action potentials, current-induced voltage responses and electrotonic structures. , 1993, Journal of neurophysiology.

[48]  Örjan Ekeberg,et al.  A One-Layer Feedback Artificial Neural Network with a Bayesian Learning Rule , 1989, Int. J. Neural Syst..

[49]  T. Wiesel,et al.  Lateral interactions in visual cortex. , 1990, Cold Spring Harbor symposia on quantitative biology.

[50]  B. Connors,et al.  Intrinsic firing patterns of diverse neocortical neurons , 1990, Trends in Neurosciences.

[51]  J M Fuster,et al.  Neuronal firing in the inferotemporal cortex of the monkey in a visual memory task , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[52]  A. Cowey,et al.  Interlaminar and lateral excitatory amino acid connections in the striate cortex of monkey , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[53]  Anders Holst,et al.  The Use of a Bayesian Neural Network Model for Classification Tasks , 1997 .

[54]  Anders Lansner,et al.  Modelling Hebbian cell assemblies comprised of cortical neurons , 1992 .

[55]  J. Fuster Memory in the cerebral cortex , 1994 .

[56]  Kevan A. C. Martin,et al.  A Canonical Microcircuit for Neocortex , 1989, Neural Computation.

[57]  G. Blasdel,et al.  Intrinsic connections of macaque striate cortex: axonal projections of cells outside lamina 4C , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[58]  K. Stratford,et al.  Synaptic transmission between individual pyramidal neurons of the rat visual cortex in vitro , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[59]  S. Grillner,et al.  Computer simulations of N-methyl-D-aspartate receptor-induced membrane properties in a neuron model. , 1991, Journal of neurophysiology.

[60]  Roger A. Nicoll Cajal's rational psychology , 1994, Nature.

[61]  R. Foehring,et al.  Correlation of physiologically and morphologically identified neuronal types in human association cortex in vitro. , 1991, Journal of neurophysiology.

[62]  D C Plaut,et al.  Simulating brain damage. , 1993, Scientific American.

[63]  Stephen A. Ritz,et al.  Distinctive features, categorical perception, and probability learning: some applications of a neural model , 1977 .

[64]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[65]  Peter Somogyi,et al.  Diverse sources of hippocampal unitary inhibitory postsynaptic potentials and the number of synaptic release sites , 1994, Nature.

[66]  D. Whitteridge,et al.  An intracellular analysis of the visual responses of neurones in cat visual cortex. , 1991, The Journal of physiology.

[67]  S Löwel,et al.  Ocular dominance column development: strabismus changes the spacing of adjacent columns in cat visual cortex. , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[68]  A. Peters,et al.  Neuronal organization in area 17 of cat visual cortex. , 1993, Cerebral cortex.

[69]  J. Szentágothai The Ferrier Lecture, 1977 The neuron network of the cerebral cortex: a functional interpretation , 1978, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[70]  D Ferster,et al.  Synaptic excitation of neurones in area 17 of the cat by intracortical axon collaterals of cortico‐geniculate cells. , 1985, The Journal of physiology.

[71]  Paul Smolensky,et al.  Information processing in dynamical systems: foundations of harmony theory , 1986 .

[72]  P. Goldman-Rakic,et al.  Posterior parietal cortex in rhesus monkey: II. Evidence for segregated corticocortical networks linking sensory and limbic areas with the frontal lobe , 1989, The Journal of comparative neurology.

[73]  C. Gilbert,et al.  The projections of cells in different layers of the cat's visual cortex , 1975, The Journal of comparative neurology.

[74]  A. Lansner,et al.  Low spiking rates in a population of mutually exciting pyramidal cells , 1995 .

[75]  E Tulving,et al.  Priming and human memory systems. , 1990, Science.

[76]  T. Powell,et al.  The basic uniformity in structure of the neocortex. , 1980, Brain : a journal of neurology.

[77]  Daniel J. Amit,et al.  Attractor neural networks with biological probe records , 1990 .

[78]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[79]  A. Lansner,et al.  Modelling Hebbian cell assemblies comprised of cortical neurons , 1992 .

[80]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[81]  G. Edelman,et al.  Reentry and the problem of integrating multiple cortical areas: simulation of dynamic integration in the visual system. , 1992, Cerebral cortex.

[82]  Bo Cartling Control Of The Complexity Of Associative Memory Dynamics By Neuronal Adaptation , 1993, Int. J. Neural Syst..

[83]  R B Illing,et al.  More modules. , 1993, Trends in neurosciences.

[84]  S. Nelson,et al.  An emergent model of orientation selectivity in cat visual cortical simple cells , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[85]  J. Bullier,et al.  Parallel versus serial processing: new vistas on the distributed organization of the visual system , 1995, Current Opinion in Neurobiology.

[86]  R. Douglas,et al.  A functional microcircuit for cat visual cortex. , 1991, The Journal of physiology.

[87]  V. Mountcastle Modality and topographic properties of single neurons of cat's somatic sensory cortex. , 1957, Journal of neurophysiology.

[88]  S. Grillner,et al.  Computer simulations of NMDA and non-NMDA receptor-mediated synaptic drive: sensory and supraspinal modulation of neurons and small networks. , 1993, Journal of neurophysiology.

[89]  R. Hoffman,et al.  Parallel distributed processing and the emergence of schizophrenic symptoms. , 1993, Schizophrenia bulletin.