Growing Hierarchical Tree SOM: An unsupervised neural network with dynamic topology

In this paper we introduce a tree structured self-organizing network, called the Growing Hierarchical Tree SOM (GHTSOM), that combines unsupervised learning with a dynamic topology for hierarchical classification of unlabelled data sets. The main feature of the proposed model is a SOM-like self-organizing process that allows the network to adapt the topology of each layer of the hierarchy to the characteristics of the training set. In particular the self-organization is obtained in two steps: the first one concerns the learning phase and is finalized with the creation of a tree of SOMs, while the second one is in regard to the clustering phase and provides the formation of classes for each level of the tree (hence self-organization not only for training but also for the creation of topological connections). As a result the network works without the need for user-defined parameters. Experimental results are proposed on both synthetic and real data sets.

[1]  T. Kohonen.  Self-organized formation of topographically correct feature maps , 1982 .

[2]  Bernd Fritzke.  Growing Grid — a self-organizing network with constant neighborhood range and adaptation strength , 1995, Neural Processing Letters.

[3]  Alfonso Valencia,et al.  A hierarchical unsupervised growing neural network for clustering gene expression patterns , 2001, Bioinform..

[4]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[5]  J. Mesirov,et al.  Interpreting patterns of gene expression with self-organizing maps: methods and application to hematopoietic differentiation. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Neil Davey,et al.  Hierarchical classification with a competitive evolutionary neural tree , 1999, Neural Networks.

[7]  Brian Everitt,et al.  Cluster analysis , 1974 .

[8]  Erkki Oja,et al.  Kohonen Maps , 1999, Encyclopedia of Machine Learning.

[9]  Janos Racz,et al.  Knowledge representation by dynamic competitive learning techniques , 1991, Defense + Commercial Sensing.

[10]  V. Burzevski,et al.  Hierarchical growing cell structures , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[11]  Joaquin Dopazo,et al.  Self‐organizing tree‐growing network for the classification of protein sequences , 1998, Protein science : a publication of the Protein Society.

[12]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[13]  Bernd Fritzke,et al.  Kohonen Feature Maps and Growing Cell Structures - a Performance Comparison , 1992, NIPS.

[14]  Andreas Rauber,et al.  The growing hierarchical self-organizing map , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[15]  Bernd Fritzke,et al.  Unsupervised clustering with growing cell structures , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[16]  Bernd Fritzke,et al.  Growing cell structures--A self-organizing network for unsupervised and supervised learning , 1994, Neural Networks.

[17]  Risto Miikkulainen,et al.  Modeling Self-Organization in the Visual Cortex* , 1999 .

[18]  Helge J. Ritter,et al.  Neural computation and self-organizing maps - an introduction , 1992, Computation and neural systems series.

[19]  P. Brown,et al.  Exploring the metabolic and genetic control of gene expression on a genomic scale. , 1997, Science.

[20]  Teuvo Kohonen,et al.  Self-organization and associative memory: 3rd edition , 1989 .

[21]  J. Dopazo,et al.  Phylogenetic Reconstruction Using an Unsupervised Growing Neural Network That Adopts the Topology of a Phylogenetic Tree , 1997, Journal of Molecular Evolution.

[22]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[23]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[24]  T. Kohonen,et al.  Self-organizing semantic maps , 1989, Biological Cybernetics.

[25]  Risto Miikkulainen,et al.  Incremental grid growing: encoding high-dimensional structure into a two-dimensional feature map , 1993, IEEE International Conference on Neural Networks.

[26]  Liping Yu,et al.  Solution structure and function of an essential CMP kinase of Streptococcus pneumoniae , 2003, Protein science : a publication of the Protein Society.