A network that uses few active neurones to code visual input predicts the diverse shapes of cortical receptive fields

Computational models of primary visual cortex have demonstrated that principles of efficient coding and neuronal sparseness can explain the emergence of neurones with localised oriented receptive fields. Yet, existing models have failed to predict the diverse shapes of receptive fields that occur in nature. The existing models used a particular “soft” form of sparseness that limits average neuronal activity. Here we study models of efficient coding in a broader context by comparing soft and “hard” forms of neuronal sparseness.As a result of our analyses, we propose a novel network model for visual cortex. The model forms efficient visual representations in which the number of active neurones, rather than mean neuronal activity, is limited. This form of hard sparseness also economises cortical resources like synaptic memory and metabolic energy. Furthermore, our model accurately predicts the distribution of receptive field shapes found in the primary visual cortex of cat and monkey.

[1]  R. Hetherington The Perception of the Visual World , 1952 .

[2]  F. Attneave Some informational aspects of visual perception. , 1954, Psychological review.

[3]  H. Quastler Information theory in psychology , 1955 .

[4]  J. M. Stroud THE FINE STRUCTURE OF PSYCHOLOGICAL TIME , 1967 .

[5]  H. C. LONGUET-HIGGINS,et al.  Non-Holographic Associative Memory , 1969, Nature.

[6]  A. R. Gardner-Medwin The recall of events through the learning of associations between their parts , 1976, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[7]  Horace Barlow,et al.  Understanding Natural Vision , 1983 .

[8]  J. P. Jones,et al.  The two-dimensional spatial structure of simple receptive fields in cat striate cortex. , 1987, Journal of neurophysiology.

[9]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[10]  Joachim M. Buhmann,et al.  Storing sequences of biased patterns in neural networks with stochastic dynamics , 1988 .

[11]  M. Tsodyks,et al.  The Enhanced Storage Capacity in Neural Networks with Low Activity Level , 1988 .

[12]  David C. Van Essen,et al.  Information processing strategies and pathways in the primate retina and visual cortex , 1990 .

[13]  G. Hartmann,et al.  Parallel Processing in Neural Systems and Computers , 1990 .

[14]  Alessandro ' Iteves Dilution and sparse coding in threshold-linear nets , 1991 .

[15]  Eytan Domany,et al.  Models of Neural Networks I , 1991 .

[16]  Günther Palm,et al.  Information capacity in recurrent McCulloch-Pitts networks with sparsely coded memory states , 1992 .

[17]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[18]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[19]  J. Budd,et al.  A numerical analysis of the geniculocortical input to striate cortex in the monkey. , 1994, Cerebral cortex.

[20]  D. Ruderman The statistics of natural images , 1994 .

[21]  Zhaoping Li,et al.  Toward a Theory of the Striate Cortex , 1994, Neural Computation.

[22]  Zhaoping Li,et al.  Towards a theory of striate cortex , 1994 .

[23]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[24]  Friedrich T. Sommer,et al.  Associative Data Storage and Retrieval in Neural Networks , 1996 .

[25]  Roland Baddeley,et al.  An efficient code in V1? , 1996, Nature.

[26]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[27]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[28]  Brian Sallans,et al.  A Hierarchical Community of Experts , 1999, Learning in Graphical Models.

[29]  Peter Földiák,et al.  Sparse coding in the primate cortex , 1998 .

[30]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[31]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[32]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[33]  M. A. Repucci,et al.  Spatial Structure and Symmetry of Simple-Cell Receptive Fields in Macaque Primary Visual Cortex , 2002 .

[34]  Bruno A. Olshausen,et al.  Learning Sparse Multiscale Image Representations , 2002, NIPS.

[35]  L. Rebollo-Neira,et al.  Optimized orthogonal matching pursuit approach , 2002, IEEE Signal Processing Letters.

[36]  Michael Elad,et al.  Optimally sparse representation in general (nonorthogonal) dictionaries via ℓ1 minimization , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[37]  Terrence J Sejnowski,et al.  Communication in Neuronal Networks , 2003, Science.

[38]  C. Koch,et al.  Is perception discrete or continuous? , 2003, Trends in Cognitive Sciences.

[39]  Aapo Hyvärinen,et al.  Simple-Cell-Like Receptive Fields Maximize Temporal Coherence in Natural Video , 2003, Neural Computation.

[40]  M. Bethge,et al.  Second order phase transition in neural rate coding: binary encoding is optimal for rapid signal transmission. , 2003, Physical review letters.

[41]  Yee Whye Teh,et al.  Energy-Based Models for Sparse Overcomplete Representations , 2003, J. Mach. Learn. Res..

[42]  P. Lennie The Cost of Cortical Computation , 2003, Current Biology.

[43]  E. B. Baum,et al.  Internal representations for associative memory , 1988, Biological Cybernetics.

[44]  Gerd Willwacher,et al.  Storage of a temporal pattern sequence in a network , 2004, Biological Cybernetics.

[45]  Simon J. Thorpe,et al.  Sparse spike coding in an asynchronous feed-forward multi-layer neural network using matching pursuit , 2004, Neurocomputing.

[46]  B. Olshausen,et al.  Statistical methods for image and signal processing , 2004 .

[47]  G. Palm,et al.  On associative memory , 2004, Biological Cybernetics.

[48]  Thomas Wennekers,et al.  Synfire chains with conductance-based neurons: internal timing and coordination with timed input , 2005, Neurocomputing.

[49]  C. Koch,et al.  Attention-driven discrete sampling of motion perception. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[50]  Martin Rehn,et al.  Storing and restoring visual input with collaborative rank coding and associative memory , 2006, Neurocomputing.