Consensus Clustering Based on Particle Swarm Optimization Algorithm

Clustering is an important data mining task and has been explored extensively by a number of researchers for different application areas. The clustering ensembles combine multiple partitions generated by different clustering algorithms into a single clustering solution. Clustering ensembles have emerged as a prominent method for improving robustness, stability and accuracy of clustering solutions. So far, many contributions have been made to find consensus clustering. One of the major problems in clustering ensembles is the consensus function. In this paper, the Particle Swarm Optimization algorithm (PSO) is proposed to solve the consensus clustering problem. We find that the particle swarm clustering algorithm is efficient for this problem. An empirical study compares the accuracy of our proposed algorithms with other consensus clustering methods including voting on five data sets. The experimental results show that the PSO consensus clustering method produces clustering's that are as good as, and often better than, these other methods.

[1]  Joydeep Ghosh,et al.  Cluster Ensembles --- A Knowledge Reuse Framework for Combining Multiple Partitions , 2002, J. Mach. Learn. Res..

[2]  Leandro N. de Castro,et al.  Data Clustering with Particle Swarms , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[3]  Stan Matwin,et al.  A review on particle swarm optimization algorithm and its variants to clustering high-dimensional data , 2013, Artificial Intelligence Review.

[4]  Elke Achtert,et al.  DeLi-Clu: Boosting Robustness, Completeness, Usability, and Efficiency of Hierarchical Clustering by a Closest Pair Ranking , 2006, PAKDD.

[5]  Li-ying Yang,et al.  Cluster Ensemble Based on Particle Swarm Optimization , 2009, 2009 WRI Global Congress on Intelligent Systems.

[6]  Dit-Yan Yeung,et al.  Robust path-based spectral clustering , 2008, Pattern Recognit..

[7]  Xiaoli Z. Fern,et al.  Cluster Ensembles for High Dimensional Clustering: An Empirical Study , 2006 .

[8]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[9]  Anil K. Jain,et al.  Clustering ensembles: models of consensus and weak partitions , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Gregory Piatetsky-Shapiro,et al.  Advances in Knowledge Discovery and Data Mining , 2004, Lecture Notes in Computer Science.

[11]  Shu-Kai S. Fan,et al.  Hybrid simplex search and particle swarm optimization for the global optimization of multimodal functions , 2004 .

[12]  Germano Lambert-Torres,et al.  Fitting Fuzzy Membership Functions using Hybrid Particle Swarm Optimization , 2006, 2006 IEEE International Conference on Fuzzy Systems.

[13]  Gillian Dobbie,et al.  An Evolutionary Particle Swarm Optimization algorithm for data clustering , 2008, 2008 IEEE Swarm Intelligence Symposium.

[14]  Anil K. Jain,et al.  Data Clustering: A User's Dilemma , 2005, PReMI.

[15]  Andries Petrus Engelbrecht,et al.  Data clustering using particle swarm optimization , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[16]  Anil K. Jain,et al.  A Mixture Model for Clustering Ensembles , 2004, SDM.

[17]  Dilson Lucas Pereira,et al.  Study of different approach to clustering data by using the Particle Swarm Optimization Algorithm , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[18]  Umeshwar Dayal,et al.  K-Harmonic Means - A Data Clustering Algorithm , 1999 .

[19]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[20]  Hamidah Ibrahim,et al.  A Survey: Clustering Ensembles Techniques , 2009 .

[21]  Rich Caruana,et al.  Consensus Clusterings , 2007, Seventh IEEE International Conference on Data Mining (ICDM 2007).

[22]  A. Esmin,et al.  APPLICATION OF PARTICLE SWARM OPTIMIZATION TO OPTIMAL POWER SYSTEMS , 2011 .