Integrating Fuzzy K-Means, Particle Swarm Optimization, and Imperialist Competitive Algorithm for Data Clustering

In this paper, we proposed two hybrid data clustering algorithms that are called ICAFKM and PSOFKM. ICAFKM combined the advantageous aspects of Fuzzy K-Means (FKM) and Imperialist Competitive Algorithm (ICA), and PSOFKM makes full use of the merits of both Particle Swarm Optimization (PSO) and FKM algorithms. FKM is one of the most popular data clustering methods. However, this algorithm solves the problem of sensitivity to initial states of K-Means (KM) algorithm, but like KM, it often converges to local optima. The proposed ICAFKM and PSOFKM algorithms aim to help the FKM to escape from local optima and increase the convergence speed of the ICA and PSO algorithms in clustering process. In order to evaluate the performance of ICAFKM and PSOFKM methods, we evaluate these algorithms on five datasets and compared them with FKM, ICA, PSO, PSOKHM, and HABC algorithms. The experimental results indicate that the ICAFKM carries out better results than the other methods.

[1]  Tieli Sun,et al.  An efficient hybrid data clustering method based on K-harmonic means and Particle Swarm Optimization , 2009, Expert Syst. Appl..

[2]  Samaneh Hajy Mahdizadeh Zargar,et al.  Fuzzy improved genetic k-means algorithm , 2011, 2011 19th Iranian Conference on Electrical Engineering.

[3]  Hinrich Schütze,et al.  Introduction to information retrieval , 2008 .

[4]  Tania S. Douglas,et al.  Fuzzy clustering to detect tuberculous meningitis-associated hyperdensity in CT images , 2008, Comput. Biol. Medicine.

[5]  Xiaohui Yan,et al.  A new approach for data clustering using hybrid artificial bee colony algorithm , 2012, Neurocomputing.

[6]  Steven Furnell,et al.  D-FICCA: A density-based fuzzy imperialist competitive clustering algorithm for intrusion detection in wireless sensor networks , 2014 .

[7]  Ping Li,et al.  Sampling Fuzzy K-Means Clustering Algorithm Based on Clonal Optimization , 2006, 2006 6th World Congress on Intelligent Control and Automation.

[8]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[9]  Himansu Sekhar Behera,et al.  Fuzzy C-Means (FCM) Clustering Algorithm: A Decade Review from 2000 to 2014 , 2015 .

[10]  Sara Nasser,et al.  A Modified Fuzzy K-means Clustering using Expectation Maximization , 2006, 2006 IEEE International Conference on Fuzzy Systems.

[11]  Ahmet Arslan,et al.  A hybrid method for imputation of missing values using optimized fuzzy c-means with support vector regression and a genetic algorithm , 2013, Inf. Sci..

[12]  Ching-Chang Wong,et al.  K-means-based fuzzy classifier design , 2000, Ninth IEEE International Conference on Fuzzy Systems. FUZZ- IEEE 2000 (Cat. No.00CH37063).

[13]  Norio Watanabe,et al.  Fuzzy k-means clustering with crisp regions , 2001, 10th IEEE International Conference on Fuzzy Systems. (Cat. No.01CH37297).

[14]  A. Gandomi,et al.  Imperialist competitive algorithm combined with chaos for global optimization , 2012 .

[15]  Jun Sun,et al.  A hybrid fuzzy K-harmonic means clustering algorithm , 2015 .

[16]  Jim Z. C. Lai,et al.  A Fuzzy K-means Clustering Algorithm Using Cluster Center Displacement , 2009, J. Inf. Sci. Eng..

[17]  J. Bezdek,et al.  FCM: The fuzzy c-means clustering algorithm , 1984 .

[18]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[19]  Christine M. Anderson-Cook.  Practical Genetic Algorithms (2nd ed.) , 2005 .

[20]  Himansu Sekhar Behera,et al.  An Improved Firefly Fuzzy C-Means (FAFCM) Algorithm for Clustering Real World Data Sets , 2014 .

[21]  Umi Kalthum Ngah,et al.  Adaptive fuzzy moving K-means clustering algorithm for image segmentation , 2009, IEEE Transactions on Consumer Electronics.

[22]  Shailendra Kumar Shrivastava,et al.  Clustering of Image Data Set Using K-Means and Fuzzy K-Means Algorithms , 2010, 2010 International Conference on Computational Intelligence and Communication Networks.

[23]  Michael K. Ng,et al.  Agglomerative Fuzzy K-Means Clustering Algorithm with Selection of Number of Clusters , 2008, IEEE Transactions on Knowledge and Data Engineering.

[24]  Ming Yang,et al.  An improved fuzzy k-means clustering with k-center initialization , 2010, Third International Workshop on Advanced Computational Intelligence.