Self-organization in neural networks subject to random transformations

Transformations of the visual input, corresponding to eye movements and object motions, are of obvious importance in vision. This paper concerns the detection by prototype visual neural networks of the symmetry group structures which underlie such transformations. It is shown that a prototype network, with a simple Kohonen-type learning rule, self-organises in response to random transformations, to form an efficient and regular representation of the underlying symmetry groups. The convergence is irregular rather than smooth. Results are presented for networks with various combinations of rotation and (in 2D) dilation and translation. Some conclusions are drawn about the behaviour and possible applications of such networks and their relationship to other networks is briefly discussed.

[1]  R Linsker,et al.  From basic network principles to neural architecture: emergence of orientation-selective cells. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[2]  J. Gibson The perception of the visual world , 1951 .

[3]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[4]  Richard Durbin,et al.  A dimension reduction framework for understanding cortical maps , 1990, Nature.

[5]  Ingrid Daubechies,et al.  The wavelet transform, time-frequency localization and signal analysis , 1990, IEEE Trans. Inf. Theory.

[6]  Reiner Lenz A group theoretical approach to filter design , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[7]  W. Hoffman The Lie algebra of visual perception , 1966 .

[8]  A. Yuille,et al.  Spontaneous symmetry-breaking energy functions and the emergence of orientation selective cortical cells , 2004, Biological Cybernetics.

[9]  Takayuki Ito,et al.  Neocognitron: A neural network model for a mechanism of visual pattern recognition , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[10]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.