Attractor neural networks with patchy connectivity

The neurons in the mammalian visual cortex are arranged in columnar structures, and the synaptic contacts of the pyramidal neurons in layer II/III are clustered into patches that are sparsely distributed over the surrounding cortical surface. Here, we use an attractor neural-network model of the cortical circuitry and investigate the effects of patchy connectivity, both on the properties of the network and the attractor dynamics. An analysis of the network shows that the signal-to-noise ratio of the synaptic potential sums are improved by the patchy connectivity, which results in a higher storage capacity. This analysis is performed for both the Hopfield and Willshaw learning rules and the results are confirmed by simulation experiments.

[1]  J. Fuster.  Memory in the cerebral cortex , 1994 .

[2]  E. Rolls,et al.  Neural networks and brain function , 1998 .

[3]  T. Wiesel,et al.  Functional architecture of macaque monkey visual cortex , 1977 .

[4]  David J. Willshaw,et al.  Improving recall from an associative memory , 1995, Biological Cybernetics.

[5]  D. Hubel,et al.  Ferrier lecture - Functional architecture of macaque monkey visual cortex , 1977, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[6]  A. Lansner,et al.  An abstract model of a cortical hypercolumn , 2002, Proceedings of the 9th International Conference on Neural Information Processing, 2002. ICONIP '02..

[7]  Martin R. Evans,et al.  Random dilution in a neural network for biased patterns , 1989 .

[8]  Anders Lansner,et al.  Towards Cortex Sized Artificial Nervous Systems , 2004, KES.

[9]  J. Boyd,et al.  Intrinsic connections in cat visual cortex: a combined anterograde and retrograde tracing study , 1991, Brain Research.

[10]  Anders Lansner,et al.  Selective enhancement of recall through plasticity modulation in an autoassociative memory , 2001, Neurocomputing.

[11]  Anders Lansner,et al.  Cell assembly dynamics in detailed and abstract attractor models of cortical associative memory , 2003, Theory in Biosciences.

[12]  G. Palm,et al.  Towards a theory of cell assemblies , 2004, Biological Cybernetics.

[13]  Alexander A. Frolov,et al.  Informational Capacity and Recall Quality in Sparsely Encoded Hopfield-like Neural Network: Analytical Approaches and Computer Simulation , 1997, Neural Networks.

[14]  V. Mountcastle.  The columnar organization of the neocortex. , 1997, Brain : a journal of neurology.

[15]  A. Lansner,et al.  A working memory model based on fast Hebbian learning , 2003, Network.

[16]  Michael Menzinger,et al.  Topology and computational performance of attractor neural networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[17]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[18]  D. Buxhoeveden,et al.  The minicolumn hypothesis in neuroscience. , 2002, Brain : a journal of neurology.

[19]  Prof. Dr. Dr. Valentino Braitenberg,et al.  Cortex: Statistics and Geometry of Neuronal Connectivity , 1998, Springer Berlin Heidelberg.

[20]  D. McCormick,et al.  Turning on and off recurrent balanced cortical activity , 2003, Nature.

[21]  V. Mountcastle.  Modality and topographic properties of single neurons of cat's somatic sensory cortex. , 1957, Journal of neurophysiology.

[22]  Guillermo Abramson,et al.  Associative memory on a small-world neural network , 2003, nlin/0310033.

[23]  Edmund T. Rolls,et al.  What determines the capacity of autoassociative memories in the brain? Network , 1991 .

[24]  T. Wiesel,et al.  Columnar specificity of intrinsic horizontal and corticocortical connections in cat visual cortex , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[25]  R. Yuste,et al.  Attractor dynamics of network UP states in the neocortex , 2003, Nature.

[26]  Bevil R. Conway,et al.  The Projection from V 1 to Extrastriate Area 21 a : A Second Patchy Efferent Pathway that Colocalizes with the CO Blob Columns in Cat Visual Cortex , 2022 .

[27]  Treves,et al.  Graded-response neurons and information encodings in autoassociative memories. , 1990, Physical review. A, Atomic, molecular, and optical physics.

[28]  Bevil R. Conway,et al.  The projection from V1 to extrastriate area 21a: a second patchy efferent pathway colocalizes with the CO blob columns in cat visual cortex. , 2000, Cerebral cortex.

[29]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[30]  Ali A. Minai,et al.  Efficient associative memory using small-world architecture , 2001, Neurocomputing.

[31]  A. Lansner,et al.  A Bayesian attractor network with incremental learning. , 2002, Network.

[32]  D. Fitzpatrick,et al.  Orientation Selectivity and the Arrangement of Horizontal Connections in Tree Shrew Striate Cortex , 1997, The Journal of Neuroscience.

[33]  T. Powell,et al.  The basic uniformity in structure of the neocortex. , 1980, Brain : a journal of neurology.