Clustering Properties of Hierarchical Self-Organizing Maps

A multilayer hierarchical self-organizing map (HSOM) is discussed as an unsupervised clustering method. The HSOM is shown to form arbitrarily complex clusters, in analogy with multilayer feedforward networks. In addition, the HSOM provides a natural measure for the distance of a point from a cluster that weighs all the points belonging to the cluster appropriately. In experiments with both artificial and real data it is demonstrated that the multilayer SOM forms clusters that match better to the desired classes than do direct SOM's, classical k-means, or Isodata algorithms.

[1]  J. Gower,et al.  Minimum Spanning Trees and Single Linkage Cluster Analysis , 1969 .

[2]  Shun-Ichi Amari,et al.  Topographic organization of nerve fields , 1979, Neuroscience Letters.

[3]  T. Kohonen.  Self-organized formation of topographically correct feature maps , 1982 .

[4]  Josef Kittler,et al.  Pattern recognition : a statistical approach , 1982 .

[5]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[6]  K. Schulten,et al.  Kohonen's self-organizing maps: exploring their computational capabilities , 1988, IEEE 1988 International Conference on Neural Networks.

[7]  Stephen P. Luttrell.  Image compression using a multilayer neural network , 1989, Pattern Recognit. Lett..

[8]  Hecht-Nielsen.  Theory of the backpropagation neural network , 1989 .

[9]  S. P. Luttrell,et al.  Self-organisation: a derivation from first principles of a class of learning algorithms , 1989, International 1989 Joint Conference on Neural Networks.

[10]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[11]  Helge J. Ritter,et al.  A neural network model for the formation of topographic maps in the CNS: development of receptive fields , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[12]  Eric B. Baum,et al.  When Are k-Nearest Neighbor and Back Propagation Accurate for Feasible Sized Sets of Examples? , 1990, EURASIP Workshop.

[13]  Jirí Benes,et al.  On neural networks , 1990, Kybernetika.

[14]  T. Kohonen.  SELF-ORGANIZING MAPS: OPHMIZATION APPROACHES , 1991 .

[15]  Richard Lippmann,et al.  Neural Network Classifiers Estimate Bayesian a posteriori Probabilities , 1991, Neural Computation.

[16]  J Lampinen.  DISTORTION TOLERANT PATTERN-RECOGNITION USING INVARIANT TRANSFORMATIONS AND HIERARCHICAL SOFM CLUSTERING , 1991 .