A clustering algorithm based on integration of K-Means and PSO

Clustering data are one of the key issues in data mining that has attracted much attention. One of the famous algorithms in this field is K-Means clustering that has been successfully applied to many problems. But this method has its own disadvantages, such as the dependence of the efficiency of this method to initialization of cluster centers. To improve the quality of K-Means, hybridization of this algorithm with other methods suggested by many researchers. Particle Swarm Optimization (PSO) is one of Swarm Intelligence (SI) algorithms that has been combined with K-Means in various ways. In this paper, we suggest another way of combining K-Means and PSO, using the strength of both algorithms. Most of the methods introduced in the context of clustering, that hybridized K-Means and PSO, used them sequentially, but in this paper we applied them intertwined. The results of the investigation of this algorithm, on the number of benchmark databases from UCI Machine Learning Repository, reflect the ability of this approach in clustering analysis.

[1]  Ching-Yi Chen,et al.  Alternative KPSO-Clustering Algorithm , 2005 .

[2]  Rajesh Kumar,et al.  A review on particle swarm optimization algorithms and their applications to data clustering , 2011, Artificial Intelligence Review.

[3]  Andries Petrus Engelbrecht,et al.  Data clustering using particle swarm optimization , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[4]  Stan Matwin,et al.  A review on particle swarm optimization algorithm and its variants to clustering high-dimensional data , 2013, Artificial Intelligence Review.

[5]  Di Yuan,et al.  K-means Optimization Clustering Algorithm Based on Particle Swarm Optimization and Multiclass Merging , 2012 .

[6]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[7]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[8]  Taher Niknam,et al.  An efficient hybrid approach based on PSO, ACO and k-means for cluster analysis , 2010, Appl. Soft Comput..

[9]  Dervis Karaboga,et al.  A novel clustering approach: Artificial Bee Colony (ABC) algorithm , 2011, Appl. Soft Comput..

[10]  Xiaohui Cui,et al.  Document Clustering Analysis Based on Hybrid PSO+K-means Algorithm , 2005 .

[11]  Himansu Sekhar Behera,et al.  Evolutionary Improved Swarm-Based Hybrid K-Means Algorithm for Cluster Analysis , 2016 .

[12]  Shokri Z. Selim,et al.  K-Means-Type Algorithms: A Generalized Convergence Theorem and Characterization of Local Optimality , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Zwe-Lee Gaing,et al.  A particle swarm optimization approach for optimum design of PID controller in AVR system , 2004 .

[14]  Zwe-Lee Gaing.  A particle swarm optimization approach for optimum design of PID controller in AVR system , 2004, IEEE Transactions on Energy Conversion.

[15]  Erwie Zahara,et al.  A hybridized approach to data clustering , 2008, Expert Syst. Appl..

[16]  Miin-Shen Yang,et al.  Alternative c-means clustering algorithms , 2002, Pattern Recognit..

[17]  Ching-Yi Chen,et al.  Particle swarm optimization algorithm and its application to clustering analysis , 2004, 2012 Proceedings of 17th Conference on Electrical Power Distribution.

[18]  Taher Niknam,et al.  A new fuzzy adaptive hybrid particle swarm optimization algorithm for non-linear, non-smooth and non-convex economic dispatch problem , 2010 .