Optimization strategies for rapid centroid estimation

Particle swarm algorithm has been extensively utilized as a tool to solve optimization problems. Recently proposed particle swarm±based clustering algorithm called the Rapid Centroid Estimation (RCE) is a lightweight alteration to Particle Swarm Clustering (PSC). The RCE in its standard form is shown to be superior to conventional PSC algorithm. We have observed some limitations in RCE including the possibility to stagnate at a local minimum combination and the restriction in swarm size. We propose strategies to optimize RCE further by introducing RCE+ and swarm RCE+. Five benchmark datasets from UCI machine learning database are used to test the performance of these new strategies. In Glass dataset swarm RCE+ is able to achieve highest purity centroid combinations with less iteration (90.3%±1.1% in 9±5 iterations) followed by RCE+ (89%±3.5% in 65±62 iterations) and RCE (87%±5.9% in 54±44). Similar quality is also reflected in other benchmark datasets including Iris, Wine, Breast Cancer, and Diabetes.

[1]  Hans-Peter Kriegel,et al.  Clustering high-dimensional data: A survey on subspace clustering, pattern-based clustering, and correlation clustering , 2009, TKDD.

[2]  Hung T. Nguyen,et al.  Fast unsupervised learning method for rapid estimation of cluster centroids , 2012, 2012 IEEE Congress on Evolutionary Computation.

[3]  Leandro Nunes de Castro,et al.  The proposal of a velocity memoryless clustering swarm , 2010, IEEE Congress on Evolutionary Computation.

[4]  Andries Petrus Engelbrecht,et al.  Data clustering using particle swarm optimization , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[5]  Hadi Sarvari,et al.  Harmony search algorithm for simultaneous clustering and feature selection , 2010, 2010 International Conference of Soft Computing and Pattern Recognition.

[6]  Steven W. Su,et al.  Method for increasing the computation speed of an unsupervised learning approach for data clustering , 2012, 2012 IEEE Congress on Evolutionary Computation.

[7]  Leandro N. de Castro,et al.  Data Clustering with Particle Swarms , 2006, 2006 IEEE International Conference on Evolutionary Computation.