Clustering with a Weighted Sum Validity Function Using a Niching PSO Algorithm

In this paper, we will consider an objective function called the weighted sum validity function (WSVF), which is a weighted sum of several normalized cluster validity functions. In contrast to optimization techniques intended to find a single, global solution in a problem domain, niching techniques have the ability to locate multiple solutions in multimodal domains. Hence, a niching binary particle swarm optimization (NBPSO) approach is developed for automatically constructing the proper number of clusters as well as appropriate partitioning of the data set. We also hybridize the NBPSO method with the k-means algorithm to optimize the WSVF automatically. In experiments, we show the effectiveness of the WSVF and the validity of the NBPSO. In comparison with other related PSO, the NBPSO can consistently and efficiently converge to the optimum corresponding to the given data in concurrence with the convergence result. The WSVF is found generally able to improve the confidence of clustering solutions and achieve more accurate and robust results.

[1]  Zhang Zhao-zhong A novel niche genetic algorithm of accurate optimization performance , 2004 .

[2]  Andries Petrus Engelbrecht,et al.  Niching ability of basic particle swarm optimization algorithms , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[3]  Andries Petrus Engelbrecht,et al.  Scalability of niche PSO , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[4]  Hou Li-wen Cluster Analysis Based on Particle Swarm Optimization Algorithm , 2005 .

[5]  Chung-Chun Kung,et al.  A new cluster validity criterion for fuzzy c-regression model and its application to T-S fuzzy model identification , 2004, 2004 IEEE International Conference on Fuzzy Systems (IEEE Cat. No.04CH37542).

[6]  Weiguo Sheng,et al.  A weighted sum validity function for clustering with a hybrid niching genetic algorithm , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[7]  Shen Qun-tai,et al.  Evolutionary Design of Feed-forward Neural Network Based on Species Niching Particle Swarm Optimizer , 2005 .

[8]  Changyin Sun,et al.  A Weighted Sum Validity Function for Clustering With BPSO Algorithm , 2006, 2006 Chinese Control Conference.