Dynamic clustering using combinatorial particle swarm optimization

Combinatorial Particle Swarm Optimization (CPSO) is a relatively recent technique for solving combinatorial optimization problems. CPSO has been used in different applications, e.g., partitional clustering and project scheduling problems, and it has shown a very good performance. In partitional clustering problem, CPSO needs to determine the number of clusters in advance. However, in many clustering problems, the correct number of clusters is unknown, and it is usually impossible to estimate. In this paper, an improved version, called CPSOII, is proposed as a dynamic clustering algorithm, which automatically finds the best number of clusters and simultaneously categorizes data objects. CPSOII uses a renumbering procedure as a preprocessing step and several extended PSO operators to increase population diversity and remove redundant particles. Using the renumbering procedure increases the diversity of population, speed of convergence and quality of solutions. For performance evaluation, we have examined CPSOII using both artificial and real data. Experimental results show that CPSOII is very effective, robust and can solve clustering problems successfully with both known and unknown number of clusters. Comparing the obtained results from CPSOII with CPSO and other clustering techniques such as KCPSO, CGA and K-means reveals that CPSOII yields promising results. For example, it improves 9.26 % of the value of DBI criterion for Hepato data set.

[1]  Maziar Palhang,et al.  LADPSO: using fuzzy logic to conduct PSO algorithm , 2012, Applied Intelligence.

[2]  M. Clerc,et al.  Particle Swarm Optimization , 2006 .

[3]  Tansel Özyer,et al.  Parallel clustering of high dimensional data by integrating multi-objective genetic algorithm with divide and conquer , 2009, Applied Intelligence.

[4]  Yuhui Shi,et al.  Diversity control in particle swarm optimization , 2011, 2011 IEEE Symposium on Swarm Intelligence.

[5]  Myong Kee Jeong,et al.  A two-leveled symbiotic evolutionary algorithm for clustering problems , 2012, Applied Intelligence.

[6]  Yutian Liu,et al.  An adaptive PSO algorithm for reactive power optimization , 2003 .

[7]  Erwie Zahara,et al.  A hybridized approach to data clustering , 2008, Expert Syst. Appl..

[8]  C. Tappert,et al.  A Survey of Binary Similarity and Distance Measures , 2010 .

[9]  Andries Petrus Engelbrecht,et al.  Dynamic clustering using particle swarm optimization with application in image segmentation , 2006, Pattern Analysis and Applications.

[10]  Yucheng Kao,et al.  Combining K-means and particle swarm optimization for dynamic data clustering problems , 2009, 2009 IEEE International Conference on Intelligent Computing and Intelligent Systems.

[11]  Nelson F. F. Ebecken,et al.  A genetic algorithm for cluster analysis , 2003, Intell. Data Anal..

[12]  Donald W. Bouldin,et al.  A Cluster Separation Measure , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Germán Terrazas,et al.  Nature Inspired Cooperative Strategies for Optimization, NICSO 2010, May 12-14, 2010, Granada, Spain , 2012, NISCO.

[14]  A. M. Natarajan,et al.  A New Approach for Data Clustering Based on PSO with Local Search , 2008, Comput. Inf. Sci..

[15]  K. Rameshkumar,et al.  Discrete Particle Swarm Optimization Algorithm for Data Clustering , 2008, NICSO.

[16]  Alan F. Murray,et al.  IEEE International Conference on Neural Networks , 1997 .

[17]  Ricardo J. G. B. Campello,et al.  Evolving clusters in gene-expression data , 2006, Inf. Sci..

[18]  Alberto García-Villoria,et al.  Introducing dynamic diversity into a discrete particle swarm optimization , 2009, Comput. Oper. Res..

[19]  Xin Yao,et al.  An evolutionary clustering algorithm for gene expression microarray data analysis , 2006, IEEE Transactions on Evolutionary Computation.

[20]  Michael N. Vrahatis,et al.  Particle Swarm Optimization and Intelligence: Advances and Applications , 2010 .

[21]  Kenneth Steiglitz,et al.  Combinatorial Optimization: Algorithms and Complexity , 1981 .

[22]  Emanuel Falkenauer,et al.  Genetic Algorithms and Grouping Problems , 1998 .

[23]  Andries P. Engelbrecht,et al.  Dynamic Clustering using Particle Swarm Optimization with Application in Unsupervised Image Classification , 2007 .

[24]  Bassem Jarboui,et al.  Combinatorial particle swarm optimization (CPSO) for partitional clustering problem , 2007, Appl. Math. Comput..

[25]  Taher Niknam,et al.  An efficient hybrid approach based on PSO, ACO and k-means for cluster analysis , 2010, Appl. Soft Comput..

[26]  K. Rameshkumar,et al.  Comparative evaluation of Particle Swarm Optimization Algorithms for Data Clustering using real world data sets , 2008 .

[27]  Pan Ruo-yu,et al.  Optimization Study on k Value of K-means Algorithm , 2006 .

[28]  Taher Niknam,et al.  An efficient hybrid evolutionary optimization algorithm based on PSO and SA for clustering , 2009 .

[29]  Rui Xu,et al.  Clustering Algorithms in Biomedical Research: A Review , 2010, IEEE Reviews in Biomedical Engineering.

[30]  Siriporn Supratid,et al.  Modified fuzzy ants clustering approach , 2009, Applied Intelligence.

[31]  T. Caliński,et al.  A dendrite method for cluster analysis , 1974 .

[32]  Hichem Frigui,et al.  A Robust Competitive Clustering Algorithm With Applications in Computer Vision , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Cassim Ladha,et al.  Dynamic clustering using binary multi-objective Particle Swarm Optimization for wireless sensor networks , 2008, 2008 IEEE 19th International Symposium on Personal, Indoor and Mobile Radio Communications.

[34]  S. Bandyopadhyay,et al.  Nonparametric genetic clustering: comparison of validity indices , 2001, IEEE Trans. Syst. Man Cybern. Syst..

[35]  Ujjwal Maulik,et al.  Genetic clustering for automatic evolution of clusters and application to image classification , 2002, Pattern Recognit..

[36]  Witold Pedrycz,et al.  Knowledge-Based Clustering , 2005 .

[37]  Alex Alves Freitas,et al.  A Survey of Evolutionary Algorithms for Clustering , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[38]  Ming Zhang,et al.  Integrating multi-objective genetic algorithm based clustering and data partitioning for skyline computation , 2011, Applied Intelligence.

[39]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[40]  Farid Melgani,et al.  Clustering of Hyperspectral Images Based on Multiobjective Particle Swarm Optimization , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Xindong Wu,et al.  Automatic clustering using genetic algorithms , 2011, Appl. Math. Comput..