Organizing and Exploring High-Dimensional Data with the Growing Hierarchical Self-Organizing Map

The Self-Organizing Map is a very popular unsupervised neural network model for the analysis of high-dimensional input data as in data mining applications. However, at least two limitations have to be noted, which are caused, on the one hand, by the static architecture of this model, as well as, on the other hand, by the limited capabilities for the representation of hierarchical relations of the data. With our Growing Hierarchical Self-Organizing Map we present an artificial neural network model with hierarchical architecture composed of independent growing self-organizing maps to address both limitations. The motivation is to provide a model that adapts its architecture during its unsupervised training process according to the particular requirements of the input data. The benefits of this neural network are first, a problem-dependent architecture, and second, the intuitive representation of hierarchical relations in the data. This is especially appealing in exploratory data mining applications, allowing the inherent structure of the data to unfold in a highly intuitive fashion.

[1]  Gerard Salton,et al.  Automatic Text Processing: The Transformation, Analysis, and Retrieval of Information by Computer , 1989 .

[2]  Andreas Rauber,et al.  Uncovering hierarchical structure in data using the growing hierarchical self-organizing map , 2002, Neurocomputing.

[3]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[4]  Samuel Kaski,et al.  Bibliography of Self-Organizing Map (SOM) Papers: 1981-1997 , 1998 .

[5]  Andreas Rauber,et al.  The growing hierarchical self-organizing map , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[6]  Andreas Rauber,et al.  Recent Advances with the Growing Hierarchical Self-Organizing Map , 2001, WSOM.

[7]  Andreas Rauber,et al.  Automatic labeling of self-organizing maps for information retrieval , 1999, ICONIP'99. ANZIIS'99 & ANNES'99 & ACNN'99. 6th International Conference on Neural Information Processing. Proceedings (Cat. No.99EX378).

[8]  RauberA.,et al.  The growing hierarchical self-organizing map , 2002 .

[9]  Risto Miikkulainen,et al.  Script Recognition with Hierarchical Feature Maps , 1992 .

[10]  Pasi Koikkalainen,et al.  Self-organizing hierarchical feature maps , 1990, 1990 IJCNN International Joint Conference on Neural Networks.