Integrating nature-inspired optimization algorithms to K-means clustering

Although K-means clustering algorithm is simple and popular, it has a fundamental drawback of falling into local optima that depend on the randomly generated initial centroid values. Optimization algorithms are well known for their ability to guide iterative computation in searching for global optima. They also speed up the clustering process by achieving early convergence. Contemporary optimization algorithms inspired by biology, including the Wolf, Firefly, Cuckoo, Bat and Ant algorithms, simulate swarm behavior in which peers are attracted while steering towards a global objective. It is found that these bio-inspired algorithms have their own virtues and could be logically integrated into K-means clustering to avoid local optima during iteration to convergence. In this paper, the constructs of the integration of bio-inspired optimization methods into K-means clustering are presented. The extended versions of clustering algorithms integrated with bio-inspired optimization methods produce improved results. Experiments are conducted to validate the benefits of the proposed approach.

[1]  Kathleen Steinhöfel,et al.  Stochastic Algorithms: Foundations and Applications , 2001, Lecture Notes in Computer Science.

[2]  Simon Fong,et al.  Wolf search algorithm with ephemeral memory , 2012, Seventh International Conference on Digital Information Management (ICDIM 2012).

[3]  Xin-She Yang,et al.  A New Metaheuristic Bat-Inspired Algorithm , 2010, NICSO.

[4]  Dervis Karaboga,et al.  AN IDEA BASED ON HONEY BEE SWARM FOR NUMERICAL OPTIMIZATION , 2005 .

[5]  Simon Fong,et al.  Accelerated Particle Swarm Optimization and Support Vector Machine for Business Optimization and Applications , 2011, NDT.

[6]  Natalio Krasnogor,et al.  Nature‐inspired cooperative strategies for optimization , 2009, Int. J. Intell. Syst..

[7]  Xin-She Yang,et al.  Firefly Algorithms for Multimodal Optimization , 2009, SAGA.

[8]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[9]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[10]  Xin-She Yang,et al.  Cuckoo Search via Lévy flights , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[11]  Shokri Z. Selim,et al.  K-Means-Type Algorithms: A Generalized Convergence Theorem and Characterization of Local Optimality , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  V. Mani,et al.  Clustering using firefly algorithm: Performance study , 2011, Swarm Evol. Comput..

[13]  B. Mandelbrot Fractal Geometry of Nature , 1984 .