Analysis of the convergence properties of topology preserving neural networks

The authors provide a rigorous treatment of the convergence of the topology preserving neural networks proposed by Kohonen for the one-dimensional case. The approach extends the original work by Kohonen on the convergence properties of such networks in several respects. First, the authors investigate the convergence of the neuron weights directly as compared to Kohonen's treatment of the dynamic behavior of the expectation values of the weights. Second, the problem is formulated for a more general case of selecting the neighborhood amplitude of interaction rather than the uniform amplitude. Third, the proof of convergence is based on the well-known Gladyshev theorem which uses Lyapunov's function method. The authors provide a step-by-step constructive proof which establishes the asymptotic convergence to a unique solution. This proof also provides the relation between the boundary neurons' weight vectors and the number of neurons in the network. The approach is then extended to the two-dimensional case and the result is stated in a theorem.

[1]  Zhen-Ping Lo,et al.  A neural algorithm for variable thresholding of images , 1991, [1991] Proceedings. The Fifth International Parallel Processing Symposium.

[2]  M. Cottrell,et al.  Etude d'un processus d'auto-organisation , 1987 .

[3]  Helge Ritter,et al.  Extending Kohonens Self-Organizing Mapping Algorithm to Learn Ballistic Movements , 1988 .

[4]  C. Malsburg,et al.  How patterned neural connections can be set up by self-organization , 1976, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[5]  D J Willshaw,et al.  A marker induction mechanism for the establishment of ordered neural mappings: its application to the retinotectal problem. , 1979, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[6]  B. Bavarian,et al.  A neural piecewise linear classifier for pattern classification , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[7]  Zhen-Ping Lo,et al.  Comparison of a neural network and a piecewise linear classifier , 1991, Pattern Recognit. Lett..

[8]  Helge Ritter,et al.  Topology conserving mappings for learning motor tasks , 1987 .

[9]  Han-fu Chʿen Recursive estimation and control for stochastic systems , 1985 .