A Kernel Based Clustering Algorithm using Particle Swarm Optimization

Abstract Unsupervised learning is one of the major research areas in machine learning, while kernel methods provide eficient solutions for various statistical learning problems. In this paper we propose a kernel based clustering algorithm that uses the Particle Swarm Optimization technique and discriminant functions. The method represents a general framework for solving the clustering problem: once an appropriate clustering validation index is chosen for a given class of datasets, the method performs very well in solving the problem. The method automatically detects the clusters in a given dataset and also, automatically estimates the number of clusters. Due to the use of kernel functions, our approach can be used for both linearly separable and linearly non-separable clusters. Since our algorithm uses the Particle Swarm Optimization technique, parallel computation may be used, if necessary. We evaluate our method on various datasets and we discuss its capabilities.

[1]  Mehdi Sargolzaei,et al.  A New Cooperative Algorithm Based on PSO and K-Means for Data Clustering , 2012 .

[2]  Shubha Singh,et al.  A Survey of Clustering Techniques , 2010 .

[3]  Krzysztof Kryszczuk,et al.  Estimation of the Number of Clusters Using Multiple Clustering Validity Indices , 2010, MCS.

[4]  P. V. G. D. Prasad Reddy,et al.  Performance Comparisons of PSO based Clustering , 2010, ArXiv.

[5]  Neveen I. Ghali,et al.  Exponential Particle Swarm Optimization Approach for Improving Data Clustering , 2008 .

[6]  Amit Konar,et al.  Automatic kernel clustering with a Multi-Elitist Particle Swarm Optimization Algorithm , 2008, Pattern Recognit. Lett..

[7]  Csaba Legány,et al.  Cluster validity measurement techniques , 2006 .

[8]  Ching-Yi Chen,et al.  Particle swarm optimization algorithm and its application to clustering analysis , 2004, 2012 Proceedings of 17th Conference on Electrical Power Distribution.

[9]  Marc G. Genton,et al.  Classes of Kernels for Machine Learning: A Statistics Perspective , 2002, J. Mach. Learn. Res..

[10]  Yuhui Shi,et al.  Particle swarm optimization: developments, applications and resources , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[11]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[12]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[13]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[14]  Li-Yeh Chuang,et al.  An Improved Particle Swarm Optimization for Data Clustering , 2012 .

[15]  Mu-Yen Chen,et al.  Applying particles swarm optimization for support vector machines on predicting company financial crisis , 2011 .

[16]  M. Parimala,et al.  A Survey on Density Based Clustering Algorithms for Mining Large Spatial Databases , 2011 .

[17]  Amreen Khan,et al.  An Analysis of Particle Swarm Optimization with Data Clustering-Technique for Optimization in Data Mining. , 2010 .

[18]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2004 .

[19]  J. Dunn Well-Separated Clusters and Optimal Fuzzy Partitions , 1974 .