A Learning Rule to Model the Development of Orientation Selectivity in Visual Cortex

This paper presents a learning rule, CBA, to develop oriented receptive fields similar to those founded in cat striate cortex. The inherent complexity of the development of selectivity in visual cortex has led most authors to test their models by using a restricted input environment. Only recently, some learning rules (the PCA and the BCM rules) have been studied in a realistic visual environment. For these rules, which are based upon Hebbian learning, single neuron models have been proposed in order to get a better understanding of their properties and dynamics. These models suffered from unbounded growing of synaptic strength, which is remedied by a normalization process. However, normalization seems biologically implausible, given the non-local nature of this process. A detailed stability analysis of the proposed rule proves that the CBA attains a stable state without any need for normalization. Also, a comparison among the results achieved in different types of visual environments by the PCA, the BCM and the CBA rules is provided. The final results show that the CBA rule is appropriate for studying the biological process of receptive field formation and its application in image processing and artificial vision tasks.

[1]  C. C. Law,et al.  Formation of receptive fields in realistic visual environments according to the Bienenstock, Cooper, and Munro (BCM) theory. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[2]  C. Enroth-Cugell,et al.  Receptive field properties of X and Y cells in the cat retina derived from contrast sensitivity measurements , 1982, Vision Research.

[3]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[4]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[5]  K. Miller,et al.  Synaptic Economics: Competition and Cooperation in Synaptic Plasticity , 1996, Neuron.

[6]  H. Shouval,et al.  Principal component neurons in a realistic visual environment , 1996 .

[7]  Andrzej Cichocki,et al.  A New Learning Algorithm for Blind Signal Separation , 1995, NIPS.

[8]  G. V. Goddard,et al.  Asymmetric relationships between homosynaptic long-term potentiation and heterosynaptic long-term depression , 1983, Nature.

[9]  W. Singer,et al.  Different voltage-dependent thresholds for inducing long-term depression and long-term potentiation in slices of rat visual cortex , 1990, Nature.

[10]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[11]  C. Malsburg Self-organization of orientation sensitive cells in the striate cortex , 2004, Kybernetik.

[12]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[13]  R Linsker,et al.  From basic network principles to neural architecture: emergence of orientation-selective cells. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[14]  Liming Zhang,et al.  Shaping up simple cell's receptive field of animal vision by ICA and its application in navigation system , 2003, Neural Networks.

[15]  KD Miller A model for the development of simple cell receptive fields and the ordered arrangement of orientation columns through activity-dependent competition between ON- and OFF-center inputs , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[16]  T. Sejnowski,et al.  Storing covariance with nonlinearly interacting neurons , 1977, Journal of mathematical biology.

[17]  Francisco J. Vico,et al.  Stable Neural Attractors Formation: Learning Rules and Network Dynamics , 2003, Neural Processing Letters.

[18]  C. A. Desoer,et al.  Nonlinear Systems Analysis , 1978 .

[19]  E. Oja Simplified neuron model as a principal component analyzer , 1982, Journal of mathematical biology.

[20]  Roman Bek,et al.  Discourse on one way in which a quantum-mechanics language on the classical logical base can be built up , 1978, Kybernetika.

[21]  Aapo Hyvärinen,et al.  Topographic independent component analysis as a model of V1 organization and receptive fields , 2001, Neurocomputing.

[22]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[23]  G. Lynch,et al.  Heterosynaptic depression: a postsynaptic correlate of long-term potentiation , 1977, Nature.