An efficient hybrid approach based on PSO, ACO and k-means for cluster analysis

Clustering is a popular data analysis and data mining technique. A popular technique for clustering is based on k-means such that the data is partitioned into K clusters. However, the k-means algorithm highly depends on the initial state and converges to local optimum solution. This paper presents a new hybrid evolutionary algorithm to solve nonlinear partitional clustering problem. The proposed hybrid evolutionary algorithm is the combination of FAPSO (fuzzy adaptive particle swarm optimization), ACO (ant colony optimization) and k-means algorithms, called FAPSO-ACO-K, which can find better cluster partition. The performance of the proposed algorithm is evaluated through several benchmark data sets. The simulation results show that the performance of the proposed algorithm is better than other algorithms such as PSO, ACO, simulated annealing (SA), combination of PSO and SA (PSO-SA), combination of ACO and SA (ACO-SA), combination of PSO and ACO (PSO-ACO), genetic algorithm (GA), Tabu search (TS), honey bee mating optimization (HBMO) and k-means for partitional clustering problem.

[1]  Taher Niknam,et al.  An Efficient Hybrid Evolutionary Algorithm for Cluster Analysis , 2008 .

[2]  M. Narasimha Murty,et al.  Genetic K-means algorithm , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[3]  K. alik An efficient k'-means clustering algorithm , 2008 .

[4]  Michael K. Ng,et al.  Clustering categorical data sets using tabu search techniques , 2002, Pattern Recognit..

[5]  M. Matos,et al.  Loss allocation in distribution networks with embedded generation , 2004, IEEE Transactions on Power Systems.

[6]  Zwe-Lee Gaing A particle swarm optimization approach for optimum design of PID controller in AVR system , 2004, IEEE Transactions on Energy Conversion.

[7]  Armando Leite Ferreira,et al.  Optimized RFV analysis , 2006 .

[8]  Dorothy Ndedi Monekosso,et al.  Phe-Q: A Pheromone Based Q-Learning , 2001, Australian Joint Conference on Artificial Intelligence.

[9]  Angelo Dalli Adaptation of the F-measure to Cluster Based Lexicon Quality Evaluation , 2003 .

[10]  Dorothy Ndedi Monekosso,et al.  The analysis and performance evaluation of the pheromone‐Q‐learning algorithm , 2004, Expert Syst. J. Knowl. Eng..

[11]  Dorothy Ndedi Monekosso,et al.  A review of ant algorithms , 2009, Expert Syst. Appl..

[12]  Taher Niknam,et al.  An efficient hybrid evolutionary optimization algorithm based on PSO and SA for clustering , 2009 .

[13]  Luca Maria Gambardella,et al.  A Study of Some Properties of Ant-Q , 1996, PPSN.

[14]  Ning Zhang,et al.  An Ant Colony Optimization Algorithm for Learning Classification Rules , 2006, 2006 IEEE/WIC/ACM International Conference on Web Intelligence (WI 2006 Main Conference Proceedings)(WI'06).

[15]  Krzysztof J. Cios,et al.  GAKREM: A novel hybrid clustering algorithm , 2008, Inf. Sci..

[16]  Alex Alves Freitas,et al.  Web Page Classification with an Ant Colony Algorithm , 2004, PPSN.

[17]  Alex Alves Freitas,et al.  Data mining with an ant colony optimization algorithm , 2002, IEEE Trans. Evol. Comput..

[18]  Erwie Zahara,et al.  A hybridized approach to data clustering , 2008, Expert Syst. Appl..

[19]  Taher Niknam,et al.  A Hybrid Evolutionary Algorithm Based on ACO and SA for Cluster Analysis , 2008 .

[20]  Harukazu Igarashi,et al.  Design and Application of Hybrid Intelligent Systems , 2003 .

[21]  Marco Dorigo,et al.  On the Performance of Ant-based Clustering , 2003, HIS.

[22]  S. Galvani,et al.  A particle swarm optimization approach for optimum design of PID controller in linear elevator , 2010, 2010 Conference Proceedings IPEC.

[23]  T. Niknam An Approach Based on Particle Swarm Optimization for Optimal Operation of Distribution Network Considering Distributed Generators , 2006, IECON 2006 - 32nd Annual Conference on IEEE Industrial Electronics.

[24]  Ali Maroosi,et al.  A honeybee-mating approach for cluster analysis , 2008 .

[25]  Chang Sup Sung,et al.  A tabu-search-based heuristic for clustering , 2000, Pattern Recognit..

[26]  Michael J. Laszlo,et al.  A genetic algorithm that exchanges neighboring centers for k-means clustering , 2007, Pattern Recognit. Lett..

[27]  Sanjay Ranka,et al.  An effic ient k-means clustering algorithm , 1997 .

[28]  Riccardo Poli,et al.  Particle Swarm Optimisation , 2011 .

[29]  Taher Niknam,et al.  A new fuzzy adaptive hybrid particle swarm optimization algorithm for non-linear, non-smooth and non-convex economic dispatch problem , 2010 .

[30]  Luca Maria Gambardella,et al.  Ant colony system: a cooperative learning approach to the traveling salesman problem , 1997, IEEE Trans. Evol. Comput..

[31]  C. Renée James Where did you come from , 2008 .

[32]  Ujjwal Maulik,et al.  Genetic algorithm-based clustering technique , 2000, Pattern Recognit..

[33]  B. Kulkarni,et al.  An ant colony approach for clustering , 2004 .