Growing a hypercubical output space in a self-organizing feature map

Neural maps project data from an input space onto a neuron position in a (often lower dimensional) output space grid in a neighborhood preserving way, with neighboring neurons in the output space responding to neighboring data points in the input space. A map-learning algorithm can achieve an optimal neighborhood preservation only, if the output space topology roughly matches the effective structure of the data in the input space. We here present a growth algorithm, called the GSOM or growing self-organizing map, which enhances a widespread map self-organization process, Kohonen's self-organizing feature map (SOFM), by an adaptation of the output space grid during learning. The GSOM restricts the output space structure to the shape of a general hypercubical shape, with the overall dimensionality of the grid and its extensions along the different directions being subject of the adaptation. This constraint meets the demands of many larger information processing systems, of which the neural map can be a part. We apply our GSOM-algorithm to three examples, two of which involve real world data. Using recently developed methods for measuring the degree of neighborhood preservation in neural maps, we find the GSOM-algorithm to produce maps which preserve neighborhoods in a nearly optimal fashion.

[1]  H. Ritter,et al.  Convergence properties of Kohonen's topology conserving maps: fluctuations, stability, and dimension selection , 1988, Biological Cybernetics.

[2]  Teuvo Kohonen,et al.  The self-organizing map , 1990 .

[3]  Thomas Martinetz,et al.  Topology representing networks , 1994, Neural Networks.

[4]  M. Herrmann.  Self-Organizing Feature Maps with Self-Organizing Neighborhood Widths , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[5]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[6]  Ralf Der,et al.  Controlling the Magnification Factor of Self-Organizing Feature Maps , 1996, Neural Computation.

[7]  Hans-Ulrich Bauer,et al.  Development of Oriented Ocular Dominance Bands as a Consequence of Areal Geometry , 1995, Neural Computation.

[8]  Bernd Fritzke,et al.  Growing cell structures--A self-organizing network for unsupervised and supervised learning , 1994, Neural Networks.

[9]  Peter Weierich,et al.  Unsupervised Detection of Driving States with Hierarchical Self Organizing Maps , 1994 .

[10]  Theo Geisel,et al.  A Topographic Product for the Optimization of Self-Organizing Feature Maps , 1991, NIPS.

[11]  Helge Ritter,et al.  Parametrized Self-Organizing Maps , 1993 .

[12]  Markus H. Gross,et al.  Neural network image analysis for environmental protection , 1991, Visualisierung von Umweltdaten.

[13]  Ari Hämäläinen,et al.  Using Genetic Algorithm in Self-Organizing Map Design , 1995, ICANNGA.

[14]  Helge Ritter.  Parametrized Self-Organizing Maps for Vision Learning Tasks , 1994 .

[15]  S. P. Luttrell,et al.  Self-organisation: a derivation from first principles of a class of learning algorithms , 1989, International 1989 Joint Conference on Neural Networks.

[16]  Wolfgang Rosenstiel,et al.  Considerations of geometrical and fractal dimension of SOM to get better learning results , 1994 .

[17]  Anthony H. Dekker,et al.  Kohonen neural networks for optimal colour quantization , 1994 .

[18]  Robert M. Gray,et al.  An Algorithm for Vector Quantizer Design , 1980, IEEE Trans. Commun..

[19]  Hans Werner Strube,et al.  Recognition of isolated words based on psychoacoustics and neurobiology , 1990, Speech Commun..

[20]  Klaus Pawelzik,et al.  Quantifying the neighborhood preservation of self-organizing feature maps , 1992, IEEE Trans. Neural Networks.

[21]  B. Fritzke,et al.  A growing and splitting elastic network for vector quantization , 1993, Neural Networks for Signal Processing III - Proceedings of the 1993 IEEE-SP Workshop.

[22]  Thomas Villmann,et al.  Topology Preservation in Self-Organizing Feature Maps: General Definition and Efficient Measurement , 1994, Fuzzy Days.

[23]  Helge J. Ritter,et al.  Neural computation and self-organizing maps - an introduction , 1992, Computation and neural systems series.

[24]  Helge J. Ritter,et al.  Self-organizing maps: Local competition and evolutionary optimization , 1994, Neural Networks.

[25]  C. Malsburg,et al.  How patterned neural connections can be set up by self-organization , 1976, Proceedings of the Royal Society of London. Series B. Biological Sciences.