Hybrid learning based on Multiple Self-Organizing Maps and Genetic Algorithm

Multiple Self-Organizing Maps (MSOMs) based classification methods are able to combine the advantages of both unsupervised and supervised learning mechanisms. Specifically, unsupervised SOM can search for similar properties from input data space and generate data clusters within each class, while supervised SOM can be trained from the data via label matching in the global SOM lattice space. In this work, we propose a novel classification method that integrates MSOMs with Genetic Algorithm (GA) to avoid the influence of local minima. Davies-Bouldin Index (DBI) and Mean Square Error (MSE) are adopted as the objective functions for searching the optimal solution space. Experimental results demonstrate the effectiveness and robustness of our proposed approach based on several benchmark data sets from UCI Machine Learning Repository.

[1]  Wen Gao,et al.  The supervised learning Gaussian mixture model , 2008, Journal of Computer Science and Technology.

[2]  Haibo He,et al.  SOMSO: A self-organizing map approach for spatial outlier detection with multiple attributes , 2009, 2009 International Joint Conference on Neural Networks.

[3]  Frank Dellaert,et al.  The Expectation Maximization Algorithm , 2002 .

[4]  Eisuke Kita,et al.  Investigation of self-organizing map for genetic algorithm , 2010, Adv. Eng. Softw..

[5]  Magnus Johnsson,et al.  Supervised SOM Based Architecture versus Multilayer Perceptron and RBF Networks , 2010 .

[6]  Kenneth W. Bauer,et al.  Determining input features for multilayer perceptrons , 1995, Neurocomputing.

[7]  Angel P. del Pobil,et al.  Multiple Self-Organizing Maps for Supervised Learning , 1995, IWANN.

[8]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[9]  Michael Biehl,et al.  Learning Vector Quantization: generalization ability and dynamics of competing prototypes , 2007, Similarity-based Clustering and its Application to Medicine and Biology.

[10]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[11]  Francisco Azuaje,et al.  Cluster validation techniques for genome expression data , 2003, Signal Process..

[12]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[13]  Qiong Jackson,et al.  Adaptive Bayesian contextual classification based on Markov random fields , 2002, IEEE International Geoscience and Remote Sensing Symposium.

[14]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[15]  Erkki Oja,et al.  Engineering applications of the self-organizing map , 1996, Proc. IEEE.

[16]  S. Gunn.  Support Vector Machines for Classification and Regression , 1998 .

[17]  Guoqiang Peter Zhang,et al.  Neural networks for classification: a survey , 2000, IEEE Trans. Syst. Man Cybern. Part C.

[18]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[19]  Nir Friedman,et al.  Bayesian Network Classifiers , 1997, Machine Learning.

[20]  Yen-Jen Oyang,et al.  Data classification with radial basis function networks based on a novel kernel density estimation algorithm , 2005, IEEE Transactions on Neural Networks.