Cluster Analysis by Variance Ratio Criterion and Firefly Algorithm

In order to solve the cluster analysis problem more efficiently, we presented a new approach based on firefly algorithm (FA). First, we created the optimization model using the variance ratio criterion (VRC) as fitness function. Second, FA was introduced to find the maximal point of the VRC. The experimental dataset contains 400 data of 4 groups with three different levels of overlapping degrees: non-overlapping, partial overlapping, and severely overlapping. We compared the FA with genetic algorithm (GA) and combinatorial particle swarm optimization (CPSO). Each algorithm was run 20 times. The results show that FA can found the largest VRC values among all three algorithms, while costs the least time. Therefore, FA is effective and rapid for the cluster analysis problem.

[1]  C. Cotta,et al.  A memetic-aided approach to hierarchical clustering from distance matrices: application to gene expression clustering and phylogeny. , 2003, Bio Systems.

[2]  Ivan Kojadinovic,et al.  Agglomerative hierarchical clustering of continuous variables based on mutual information , 2004, Comput. Stat. Data Anal..

[3]  Bassem Jarboui,et al.  Combinatorial particle swarm optimization (CPSO) for partitional clustering problem , 2007, Appl. Math. Comput..

[4]  K. Zehl,et al.  Fuzzy divisive hierarchical clustering of soil data using Gustafson–Kessel algorithm , 2007 .

[5]  Mustafa M. Aral,et al.  Aquifer parameter and zone structure estimation using kernel-based fuzzy c-means clustering and genetic algorithm , 2007 .

[6]  Stéphane Lecoeuche,et al.  Online clustering of switching models based on a subspace framework , 2008 .

[7]  Xianda Zhang,et al.  A genetic algorithm with gene rearrangement for K-means clustering , 2009, Pattern Recognit..

[8]  Bruno Agard,et al.  A simulated annealing method based on a clustering approach to determine bills of materials for a large product family , 2009 .

[9]  Lenan Wu,et al.  Face Orientation Estimation by Particle Swarm Optimization , 2009, 2009 Second International Symposium on Information Science and Engineering.

[10]  Ickjai Lee,et al.  Unsupervised Data Mining: Introduction , 2009 .

[11]  Jun-Lin Lin,et al.  Genetic algorithm-based clustering approach for k-anonymization , 2009, Expert Syst. Appl..

[12]  Yudong Zhang,et al.  Segment-based coding of color images , 2009, Science in China Series F: Information Sciences.

[13]  Yuankai Huo,et al.  FEATURE EXTRACTION OF BRAIN MRI BY STATIONARY WAVELET TRANSFORM AND ITS APPLICATIONS , 2010 .

[14]  Xianda Zhang,et al.  A robust dynamic niching genetic algorithm with niche migration for automatic clustering problem , 2010, Pattern Recognit..

[15]  Taher Niknam,et al.  An efficient hybrid approach based on PSO, ACO and k-means for cluster analysis , 2010, Appl. Soft Comput..

[16]  Yudong Zhang,et al.  Bacterial Foraging Optimization Based Neural Network for Short-term Load Forecasting , 2010 .

[17]  Shihong Yue,et al.  A new separation measure for improving the effectiveness of validity indices , 2010, Inf. Sci..

[18]  Nicolas Picard,et al.  Clustering species using a model of population dynamics and aggregation theory , 2010 .

[19]  Ivan Kojadinovic,et al.  Hierarchical clustering of continuous variables based on the empirical copula process and permutation linkages , 2010, Comput. Stat. Data Anal..

[20]  Alan C. Evans,et al.  Multi-level bootstrap analysis of stable clusters in resting-state fMRI , 2009, NeuroImage.

[21]  Ming-Huwi Horng,et al.  Multilevel minimum cross entropy threshold selection based on the firefly algorithm , 2011, Expert Syst. Appl..

[22]  Yudong Zhang,et al.  Face Pose Estimation by Chaotic Artificial Bee Colony , 2011 .

[23]  Yudong Zhang,et al.  Artificial Immune System for Protein Folding Model , 2011 .

[24]  Yudong Zhang,et al.  Recursive Structure Element Decomposition Using Migration Fitness Scaling Genetic Algorithm , 2011, ICSI.

[25]  V. Mani,et al.  Clustering using firefly algorithm: Performance study , 2011, Swarm Evol. Comput..

[26]  Yudong Zhang,et al.  A Hybrid TS-PSO Optimization Algorithm , 2011 .

[27]  Yudong Zhang,et al.  A Rotation Invariant Image Descriptor based on Radon Transform , 2011 .

[28]  Yudong Zhang,et al.  A Fast Document Image Denoising Method based on Packed Binary Format and Source Word Accumulation , 2011 .

[29]  A. Gandomi,et al.  Mixed variable structural optimization using Firefly Algorithm , 2011 .

[30]  Yudong Zhang,et al.  Chaotic Artificial Bee Colony Used for Cluster Analysis , 2011, ICIC 2011.

[31]  Yudong Zhang,et al.  Rigid Image Registration based on Normalized Cross Correlation and Chaotic Firefly Algorithm , 2012 .

[32]  Ming-Huwi Horng,et al.  Vector quantization using the firefly algorithm for image compression , 2012, Expert Syst. Appl..

[33]  Amir Hossein Gandomi,et al.  Firefly Algorithm for solving non-convex economic dispatch problems with valve loading effect , 2012, Appl. Soft Comput..