Co-evolution-based immune clonal algorithm for clustering

Clustering is an important tool in data mining process. Fuzzy $$c$$c-means is one of the most classic methods. But it has been criticized that it is sensitive to the initial cluster centers and is easy to fall into a local optimum. Not depending on the selection of the initial population, evolutionary algorithm is used to solve the problems existed in original fuzzy $$c$$c-means algorithm. However, evolutionary algorithm emphasizes the competition in the population. But in the real world, the evolution of biological population is not only the result of internal competition, but also the result of mutual competition and cooperation among different populations. Co-evolutionary algorithm is an emerging branch of evolutionary algorithm. It focuses on the internal competition, while on the cooperation among populations. This is more close to the process of natural biological evolution and co-evolutionary algorithm is a more excellent bionic algorithm. An immune clustering algorithm based on co-evolution is proposed in this paper. First, the clonal selection method is used to achieve the competition within population to reconstruct each population. The internal evolution of each population is completed during this process. Second, co-evolution operation is conducted to realize the information exchange among populations. Finally, the iteration results are compared with the global best individuals, with a strategy called elitist preservation, to find out the individual with a highest fitness value, that is, the result of clustering. Compared with four state-of-art algorithms, the experimental results indicate that the proposed algorithm outperforms other algorithms on the test data in the highest accuracy and average accuracy.

[1]  Mohammad Tarek Al-Muallim,et al.  Unsupervised Classification Using Immune Algorithm , 2012, ArXiv.

[2]  Yao-wen Chen,et al.  A dynamic clonal selection immune clustering algorithm , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[3]  Marc Mézard,et al.  1993 , 1993, The Winning Cars of the Indianapolis 500.

[4]  Liangpei Zhang,et al.  An Adaptive Artificial Immune Network for Supervised Classification of Multi-/Hyperspectral Remote Sensing Imagery , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Dimitrios Gunopulos,et al.  Automatic subspace clustering of high dimensional data for data mining applications , 1998, SIGMOD '98.

[6]  Chao He,et al.  Probability Density Estimation from Optimally Condensed Data Samples , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Jordan B. Pollack,et al.  A Game-Theoretic Approach to the Simple Coevolutionary Algorithm , 2000, PPSN.

[8]  Kenneth A. De Jong,et al.  The Coevolution of Antibodies for Concept Learning , 1998, PPSN.

[9]  T. Kohonen.  Self-Organized Formation of Correct Feature Maps , 1982 .

[10]  Jiao Licheng,et al.  Immunity clonal strategies , 2003, Proceedings Fifth International Conference on Computational Intelligence and Multimedia Applications. ICCIMA 2003.

[11]  Peter J. Bentley,et al.  Towards an artificial immune system for network intrusion detection: an investigation of dynamic clonal selection , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[12]  Hans-Peter Kriegel,et al.  OPTICS: ordering points to identify the clustering structure , 1999, SIGMOD '99.

[13]  Jiao Li-cheng.  Immunodomaince Based Clonal Selection Clustering Algorithm , 2010 .

[14]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[15]  Richard A. Watson,et al.  Preliminary investigations into the evolution of cooperative strategies in a minimally spatial model , 2007, GECCO '07.

[16]  F. Burnet.  A modification of jerne's theory of antibody production using the concept of clonal selection , 1976, CA: a cancer journal for clinicians.

[17]  Licheng Jiao,et al.  Clonal operator and antibody clone algorithms , 2002, Proceedings. International Conference on Machine Learning and Cybernetics.

[18]  Eghbal G. Mansoori,et al.  GACH: a grid-based algorithm for hierarchical clustering of high-dimensional data , 2014, Soft Comput..

[19]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[20]  Delbert Dueck,et al.  Clustering by Passing Messages Between Data Points , 2007, Science.

[21]  Daniel H. Janzen.  When is it co-evolution , 1980 .

[22]  Ute Beyer,et al.  Remote Sensing And Image Interpretation , 2016 .

[23]  Chi-Hoon Lee,et al.  Clustering high dimensional data: A graph-based relaxed optimization approach , 2008, Inf. Sci..

[24]  J. C. Peters,et al.  Fuzzy Cluster Analysis : A New Method to Predict Future Cardiac Events in Patients With Positive Stress Tests , 1998 .

[25]  M. Rao.  Cluster Analysis and Mathematical Programming , 1971 .

[26]  Chun Zhang,et al.  Storing and querying ordered XML using a relational database system , 2002, SIGMOD '02.

[27]  Miltiadis Kotinis,et al.  Improving a multi-objective differential evolution optimizer using fuzzy adaptation and K\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} , 2013, Soft Computing.

[28]  Leandro Nunes de Castro,et al.  The Clonal Selection Algorithm with Engineering Applications 1 , 2000 .

[29]  Kenneth A. De Jong,et al.  Cooperative Coevolution: An Architecture for Evolving Coadapted Subcomponents , 2000, Evolutionary Computation.

[30]  Ning Wang,et al.  Cooperative bare-bone particle swarm optimization for data clustering , 2014, Soft Comput..

[31]  Lihao Xu,et al.  Multiway cuts and spec-tral clustering , 2003 .

[32]  Zhaohong Deng,et al.  FRSDE: Fast reduced set density estimator using minimal enclosing ball approximation , 2008, Pattern Recognit..

[33]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[34]  Jiong Yang,et al.  STING: A Statistical Information Grid Approach to Spatial Data Mining , 1997, VLDB.

[35]  Mitchell A. Potter,et al.  EVOLVING NEURAL NETWORKS WITH COLLABORATIVE SPECIES , 2006 .

[36]  J. C. Dunn,et al.  A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters , 1973 .

[37]  Witold Pedrycz,et al.  Rough subspace-based clustering ensemble for categorical data , 2013, Soft Comput..

[38]  Waseem Ahmad,et al.  Population-Based Artificial Immune System Clustering Algorithm , 2011, ICARIS.

[39]  R. Wu,et al.  A dynamic clonal selection immune clustering algorithm. , 2008, Conference proceedings : ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual Conference.

[40]  Chun-Hung Lin,et al.  A parallel and scalable CAST-based clustering algorithm on GPU , 2013, Soft Computing.

[41]  T. Kohonen.  Self-organized formation of topographically correct feature maps , 1982 .

[42]  Yanfei Zhong,et al.  A New Fuzzy Clustering Algorithm Based on Clonal Selection for Land Cover Classification , 2011 .

[43]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[44]  Tian Zhang,et al.  BIRCH: an efficient data clustering method for very large databases , 1996, SIGMOD '96.

[45]  Sudipto Guha,et al.  CURE: an efficient clustering algorithm for large databases , 1998, SIGMOD '98.

[46]  Aidong Zhang,et al.  WaveCluster: A Multi-Resolution Clustering Approach for Very Large Spatial Databases , 1998, VLDB.

[47]  L. Jiao,et al.  Coevolutionary Computational and Multiagent Systems , 2012 .

[48]  D. Higham,et al.  A Unified View of Spectral Clustering ∗ , 2004 .

[49]  Zhengsheng Wang,et al.  An Inverse Eigenvalue Problem for Jacobi Matrices , 2011 .