Growing Self-Organizing Map with cross insert for mixed-type data clustering

Self-Organizing Map (SOM) possesses effective capability for visualizing high-dimensional data. Therefore, SOM has numerous applications in visualized clustering. Many growing SOMs have been proposed to overcome the constraint of having a fixed map size in conventional SOMs. However, most growing SOMs lack a robust solution to process mixed-type data which may include numeric, ordinal and categorical values in a dataset. Moreover, the growing scheme has an impact on the quality of resultant maps. In this paper, we propose a Growing Mixed-type SOM (GMixSOM), combining a value representation mechanism distance hierarchy with a novel growing scheme to tackle the problem of analyzing mixed-type data and to improve the quality of the projection map. Experimental results on synthetic and real-world datasets demonstrate that the proposed mechanism is feasible and the growing scheme yields better projection maps than the existing method.

[1]  Hujun Yin,et al.  ViSOM - a novel method for multivariate data projection and structure visualization , 2002, IEEE Trans. Neural Networks.

[2]  Andreas Nürnberger,et al.  Externally growing self-organizing maps and its application to e-mail database visualization and exploration , 2006, Appl. Soft Comput..

[3]  Ruey-Shiang Guh,et al.  Study of SOM-based intelligent multi-controller for real-time scheduling , 2011, Appl. Soft Comput..

[4]  Thomas Villmann,et al.  Growing a hypercubical output space in a self-organizing feature map , 1997, IEEE Trans. Neural Networks.

[5]  Risto Miikkulainen,et al.  Visualizing High-Dimensional Structure with the Incremental Grid Growing Neural Network , 1995, ICML.

[6]  Jeong Wook Lee,et al.  Proteome-Level Responses of Escherichia coli to Long-Chain Fatty Acids and Use of Fatty Acid Inducible Promoter in Protein Production , 2007, Journal of biomedicine & biotechnology.

[7]  M.N.S. Swamy,et al.  Neural networks in a softcomputing framework , 2006 .

[8]  János Abonyi,et al.  Local and global mappings of topology representing networks , 2009, Inf. Sci..

[9]  José García Rodríguez,et al.  Surveillance and human-computer interaction applications of self-growing models , 2011, Appl. Soft Comput..

[10]  Victoria J. Hodge,et al.  Hierarchical Growing Cell Structures: TreeGCS , 2001, IEEE Trans. Knowl. Data Eng..

[11]  Mohamed Chtourou,et al.  A self-organizing map-based initialization for hybrid training of feedforward neural networks , 2011, Appl. Soft Comput..

[12]  Wolfgang Banzhaf,et al.  The use of computational intelligence in intrusion detection systems: A review , 2010, Appl. Soft Comput..

[13]  Bernd Fritzke,et al.  Unsupervised clustering with growing cell structures , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[14]  Gian Luca Foresti,et al.  Growing Hierarchical Tree SOM: An unsupervised neural network with dynamic topology , 2006, Neural Networks.

[15]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[16]  Jonas Poelmans,et al.  Text mining with emergent self organizing maps and multi-dimensional scaling: A comparative study on domestic violence , 2011, Appl. Soft Comput..

[17]  Damminda Alahakoon,et al.  Dynamic self organizing maps for discovery and sharing of knowledge in multi agent systems , 2005, Web Intell. Agent Syst..

[18]  A. Hsu,et al.  Using Growing Self-Organising Maps to Improve the Binning Process in Environmental Whole-Genome Shotgun Sequencing , 2007, Journal of biomedicine & biotechnology.

[19]  Hujun Yin,et al.  The Self-Organizing Maps: Background, Theories, Extensions and Applications , 2008, Computational Intelligence: A Compendium.

[20]  Juan Miguel Ortiz-de-Lazcano-Lobato,et al.  Dynamic topology learning with the probabilistic self-organizing graph , 2011, Neurocomputing.

[21]  Reza Kerachian,et al.  Deriving operating policies for multi-objective reservoir systems: Application of Self-Learning Genetic Algorithm , 2010, Appl. Soft Comput..

[22]  Florence d'Alché-Buc,et al.  Asymptotic performances of a constructive algorithm , 2006, Neural Processing Letters.

[23]  V. Burzevski,et al.  Hierarchical growing cell structures , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[24]  Mohamed Salah Hamdi.  SOMSE: A semantic map based meta-search engine for the purpose of web information customization , 2011, Appl. Soft Comput..

[25]  Chung-Chian Hsu,et al.  Generalizing self-organizing map for categorical data , 2006, IEEE Transactions on Neural Networks.

[26]  Ke-Lin Du,et al.  Clustering: A neural network approach , 2010, Neural Networks.

[27]  Download Book,et al.  Information Visualization in Data Mining and Knowledge Discovery , 2001 .

[28]  Bernd Fritzke,et al.  Growing cell structures--A self-organizing network for unsupervised and supervised learning , 1994, Neural Networks.

[29]  I︠a︡. Z. T︠S︡ypkin,et al.  Foundations of the theory of learning systems , 1973 .

[30]  Sam Lightstone,et al.  Data Mining - Know It All , 2008 .

[31]  Risto Miikkulainen,et al.  Incremental grid growing: encoding high-dimensional structure into a two-dimensional feature map , 1993, IEEE International Conference on Neural Networks.

[32]  Bernd Fritzke.  Growing Grid — a self-organizing network with constant neighborhood range and adaptation strength , 1995, Neural Processing Letters.

[33]  Andreas Rauber,et al.  The growing hierarchical self-organizing map: exploratory analysis of high-dimensional data , 2002, IEEE Trans. Neural Networks.

[34]  Haiying Wang,et al.  Improving biomolecular pattern discovery and visualization with hybrid self-adaptive networks. , 2002, IEEE transactions on nanobioscience.

[35]  Teuvo Kohonen,et al.  The self-organizing map , 1990 .

[36]  Mika Liukkonen,et al.  Quality-oriented optimization of wave soldering process by using self-organizing maps , 2011, Appl. Soft Comput..

[37]  Dominic Palmer-Brown,et al.  Snap-drift neural network for self-organisation and sequence learning , 2011, Neural Networks.

[38]  Bala Srinivasan,et al.  Dynamic self-organizing maps with controlled growth for knowledge discovery , 2000, IEEE Trans. Neural Networks Learn. Syst..

[39]  Salah Bouhouche,et al.  Combined use of principal component analysis and self organisation map for condition monitoring in pickling process , 2011, Appl. Soft Comput..

[40]  Bernd Fritzke,et al.  Kohonen Feature Maps and Growing Cell Structures - a Performance Comparison , 1992, NIPS.

[41]  John W. Sammon,et al.  A Nonlinear Mapping for Data Structure Analysis , 1969, IEEE Transactions on Computers.

[42]  Saman K. Halgamuge,et al.  Class structure visualization with semi-supervised growing self-organizing maps , 2008, Neurocomputing.