Weight-Value Convergence of the SOM Algorithm for Discrete Input

Some insights on the convergence of the weight values of the self-organizing map (SOM) to a stationary state in the case of discrete input are provided. The convergence result is obtained by applying the Robbins-Monro algorithm and is applicable to input-output maps of any dimension.

[1]  J. Blum.  Approximation Methods which Converge with Probability one , 1954 .

[2]  Julius T. Tou,et al.  Pattern Recognition Principles , 1974 .

[3]  K. Schulten,et al.  Kohonen's self-organizing maps: exploring their computational capabilities , 1988, IEEE 1988 International Conference on Neural Networks.

[4]  Nasser M. Nasrabadi,et al.  Vector quantization of images based upon the Kohonen self-organizing feature maps , 1988, IEEE 1988 International Conference on Neural Networks.

[5]  Les E. Atlas,et al.  A comparison of the LBG algorithm and Kohonen neural network paradigm for image vector quantization , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[6]  Y. Attikiouzel,et al.  Dimension and structure of the speech space , 1992 .

[7]  G. Pagès,et al.  Self-organization and a.s. convergence of the one-dimensional Kohonen algorithm with non-uniformly distributed stimuli , 1993 .

[8]  S. Carrato.  Image vector quantization using ordered codebooks: Properties and applications , 1994, Signal Process..

[9]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[10]  Hujun Yin,et al.  On the Distribution and Convergence of Feature Space in Self-Organizing Maps , 1995, Neural Computation.

[11]  R. Horowitz,et al.  Convergence properties of self-organizing neural networks , 1995, Proceedings of 1995 American Control Conference - ACC'95.

[12]  Victor Likhovidov.  Variational Approach to Unsupervised Learning Algorithms of Neural Networks , 1997, Neural Networks.

[13]  Jennie Si,et al.  Self-Organization of Firing Activities in Monkey's Motor Cortex: Trajectory Computation from Spike Signals , 1997, Neural Computation.

[14]  Karin Haese,et al.  Self-organizing feature maps with self-adjusting learning parameters , 1998, IEEE Trans. Neural Networks.

[15]  Karin Haese,et al.  Kalman Filter Implementation of Self-Organizing Feature Maps , 1999, Neural Computation.

[16]  Shouji Sakamoto,et al.  Convergence property of topographic mapping formation from cell layer to cell layer through correlation learning rule , 2000, Neural Networks.