A natural object recognition system using Self-organizing Translation-Invariant Maps

Translation-invariant representations are a key aspect of any object categorization system. In most neural realizations, these representations are either non-adaptive and often non-optimal, or adaptive and redundant. Especially in the case of natural images containing complex features, the neural code becomes highly inefficient. In this paper, we introduce an adaptive network model which overcomes a part of this redundancy by searching for translational invariance. The model implements a Self-organizing Translation-Invariant Map (STIM) using an unsupervised competitive learning rule. The latter employs generalized weightsharing in combination with a symmetric, symmetry-breaking filter. A Kohonen-neighborhood update scheme ensures a proper covering of the feature space.

[1]  I. Biederman,et al.  Dynamic binding in a neural network for shape recognition. , 1992, Psychological review.

[2]  Allen M. Waxman,et al.  Spreading activation layers, visual saccades, and invariant representations for neural pattern recognition systems , 1989, Neural Networks.

[3]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[4]  D. V. van Essen,et al.  A neurobiological model of visual attention and invariant pattern recognition based on dynamic routing of information , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[5]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Trichur Raman Vidyasagar,et al.  Receptive field analysis and orientation selectivity of postsynaptic potentials of simple cells in cat visual cortex , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[7]  D. Signorini,et al.  Neural networks , 1995, The Lancet.

[8]  Leif H. Finkel,et al.  Object Discrimination Based on Depth-from-Occlusion , 1992, Neural Computation.

[9]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[10]  Steven W. Zucker,et al.  Two Stages of Curve Detection Suggest Two Styles of Visual Computation , 1989, Neural Computation.

[11]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[12]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[13]  J. Daugman Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[14]  A. B. Bonds,et al.  Two-dimensional receptive-field organization in striate cortical neurons of the cat , 1994, Visual Neuroscience.

[15]  Teuvo Kohonen,et al.  Things you haven't heard about the self-organizing map , 1993, IEEE International Conference on Neural Networks.

[16]  Ralph Linsker,et al.  Self-organization in a perceptual network , 1988, Computer.