A novel ant-based clustering algorithm using the kernel method

A novel ant-based clustering algorithm integrated with the kernel (ACK) method is proposed. There are two aspects to the integration. First, kernel principal component analysis (KPCA) is applied to modify the random projection of objects when the algorithm is run initially. This projection can create rough clusters and improve the algorithm's efficiency. Second, ant-based clustering is performed in the feature space rather than in the input space. The distance between the objects in the feature space, which is calculated by the kernel function of the object vectors in the input space, is applied as a similarity measure. The algorithm uses an ant movement model in which each object is viewed as an ant. The ant determines its movement according to the fitness of its local neighbourhood. The proposed algorithm incorporates the merits of kernel-based clustering into ant-based clustering. Comparisons with other classic algorithms using several synthetic and real datasets demonstrate that ACK method exhibits high performance in terms of efficiency and clustering quality.

[1]  Shihong Yue,et al.  A general grid-clustering approach , 2008, Pattern Recognit. Lett..

[2]  B. Kulkarni,et al.  An ant colony approach for clustering , 2004 .

[3]  Oscar C. Au,et al.  An adaptive unsupervised approach toward pixel clustering and color image segmentation , 2010, Pattern Recognit..

[4]  Ashish Ghosh,et al.  Aggregation pheromone density based data clustering , 2008, Inf. Sci..

[5]  Julia Handl,et al.  Ant-based and swarm-based clustering , 2007, Swarm Intelligence.

[6]  Jeng-Shyang Pan,et al.  Ant colony system with communication strategies , 2004, Inf. Sci..

[7]  Marco Dorigo,et al.  Ant-Based Clustering and Topographic Mapping , 2006, Artificial Life.

[8]  Juan Julián Merelo Guervós,et al.  Self-Organized Stigmergic Document Maps: Environment as a Mechanism for Context Learning , 2004, ArXiv.

[9]  Sam Kwong,et al.  Ant Colony Clustering and Feature Extraction for Anomaly Intrusion Detection , 2006, Swarm Intelligence in Data Mining.

[10]  Zhang Zhao-tao.  A Clustering Algorithm based on Swarm Intelligence , 2005 .

[11]  Julia Handl,et al.  Improved Ant-Based Clustering and Sorting , 2002, PPSN.

[12]  Ling Chen,et al.  A/sup 4/C: an adaptive artificial ants clustering algorithm , 2004, 2004 Symposium on Computational Intelligence in Bioinformatics and Computational Biology.

[13]  Wu Bin,et al.  CSIM: a document clustering algorithm based on swarm intelligence , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[14]  Eytan Ruppin,et al.  Neural Processing of Counting in Evolved Spiking and McCulloch-Pitts Agents , 2006, Artificial Life.

[15]  Jean-Louis Deneubourg,et al.  The dynamics of collective sorting robot-like ants and ant-like robots , 1991 .

[16]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[17]  D.M. Mount,et al.  An Efficient k-Means Clustering Algorithm: Analysis and Implementation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Marco Dorigo,et al.  Ant-based clustering: a comparative study of its relative performance with respect to k-means, average link and 1d-som , 2003 .

[19]  Lawrence O. Hall,et al.  Fuzzy Ants and Clustering , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[20]  Marco Dorigo,et al.  Strategies for the Increased Robustness of Ant-Based Clustering , 2003, Engineering Self-Organising Systems.

[21]  Patrick Brézillon,et al.  Lecture Notes in Artificial Intelligence , 1999 .

[22]  Mohamed S. Kamel,et al.  An aggregated clustering approach using multi-ant colonies algorithms , 2006, Pattern Recognit..

[23]  Swagatam Das,et al.  Kernel-induced fuzzy clustering of image pixels with an improved differential evolution algorithm , 2010, Inf. Sci..

[24]  Jian Tang,et al.  Enhancing Effectiveness of Outlier Detections for Low Density Patterns , 2002, PAKDD.

[25]  Ramiz M. Aliguliyev,et al.  Performance evaluation of density-based clustering methods , 2009, Inf. Sci..

[26]  Lei Zhang,et al.  A Modified Clustering Algorithm Based on Swarm Intelligence , 2005, ICNC.

[27]  S. Sitharama Iyengar,et al.  Adaptive neural network clustering of Web users , 2004, Computer.

[28]  Marco Dorigo,et al.  Ant algorithms and stigmergy , 2000, Future Gener. Comput. Syst..

[29]  Ashish Ghosh,et al.  Use of aggregation pheromone density for image segmentation , 2009, Pattern Recognit. Lett..

[30]  Joshua Zhexue Huang,et al.  Extensions to the k-Means Algorithm for Clustering Large Data Sets with Categorical Values , 1998, Data Mining and Knowledge Discovery.

[31]  Urszula Boryczka,et al.  Finding Groups in Data: Cluster Analysis with Ants , 2006, Sixth International Conference on Intelligent Systems Design and Applications.

[32]  Markus Breitenbach,et al.  Clustering through ranking on manifolds , 2005, ICML '05.

[33]  Mark A. Girolami,et al.  Mercer kernel-based clustering in feature space , 2002, IEEE Trans. Neural Networks.

[34]  Tian Zhang,et al.  BIRCH: an efficient data clustering method for very large databases , 1996, SIGMOD '96.

[35]  Lian Duan,et al.  A Local Density Based Spatial Clustering Algorithm with Noise , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[36]  Mohamed S. Kamel,et al.  Topic Discovery from Document Using Ant-Based Clustering Combination , 2005, APWeb.

[37]  Jeng-Shyang Pan,et al.  Constrained Ant Colony Optimization for Data Clustering , 2004, PRICAI.

[38]  Stephen J. Roberts,et al.  Maximum certainty data partitioning , 2000, Pattern Recognit..

[39]  Francesco Masulli,et al.  A survey of kernel and spectral methods for clustering , 2008, Pattern Recognit..

[40]  Martine De Cock,et al.  Clustering web people search results using fuzzy ants , 2010, Inf. Sci..

[41]  Chun Zhang,et al.  Storing and querying ordered XML using a relational database system , 2002, SIGMOD '02.

[42]  Wolfgang Rosenstiel,et al.  Automatic Cluster Detection in Kohonen's SOM , 2008, IEEE Transactions on Neural Networks.

[43]  Taher Niknam,et al.  An efficient hybrid approach based on PSO, ACO and k-means for cluster analysis , 2010, Appl. Soft Comput..

[44]  Baldo Faieta,et al.  Diversity and adaptation in populations of clustering ants , 1994 .

[45]  Martijn C. Schut,et al.  On model design for simulation of collective intelligence , 2010, Inf. Sci..

[46]  Jing Li,et al.  Ant clustering algorithm with K-harmonic means clustering , 2010, Expert Syst. Appl..