Tabu Search Particle Swarm Optimization used in Cluster Analysis

In order to solve the cluster analysis problem more efficiently and quickly, we presented a hybrid method based on Tabu Search Particle Swarm Optimization (TSPSO) in this paper. First, we built the optimization model using the variance ratio criterion (VRC) as the fitness function. Second, TSPSO was introduced to find the maximal point of the VRC. TSPSO makes full use of the exploration ability of PSO and the exploitation ability of TS and offsets the weaknesses of each other. The experimental dataset contained 400 data of 4 groups with three different levels of overlapping degrees: non-overlapping, partial overlapping, and severely overlapping. We compared the TSPSO with genetic algorithm (GA) and combinatorial particle swarm optimization (CPSO). Each algorithm ran 20 times. The convergence results showed that TSPSO could found the largest VRC values among all three algorithms, and meanwhile it cost the least time. It can conclude that TSPSO is effective and rapid for the cluster analysis problem.

[1]  Alejandro Castillo,et al.  Fuel loading and control rod patterns optimization in a BWR using tabu search , 2007 .

[2]  Yudong Zhang,et al.  Cluster Analysis by Variance Ratio Criterion and PSOSQP Algorithm , 2012 .

[3]  J. C. Belchior,et al.  An approach based on genetic algorithms and DFT for studying clusters: (H2O)n (2 ⩽ n ⩽ 13) cluster analysis , 2006 .

[4]  Yuankai Huo,et al.  FEATURE EXTRACTION OF BRAIN MRI BY STATIONARY WAVELET TRANSFORM AND ITS APPLICATIONS , 2010 .

[5]  Yudong Zhang,et al.  Recursive Structure Element Decomposition Using Migration Fitness Scaling Genetic Algorithm , 2011, ICSI.

[6]  K. Zehl,et al.  Fuzzy divisive hierarchical clustering of soil data using Gustafson–Kessel algorithm , 2007 .

[7]  Yudong Zhang,et al.  A Hybrid TS-PSO Optimization Algorithm , 2011 .

[8]  Mustafa M. Aral,et al.  Aquifer parameter and zone structure estimation using kernel-based fuzzy c-means clustering and genetic algorithm , 2007 .

[9]  Eliot Winer,et al.  Synchronous parallelization of Particle Swarm Optimization with digital pheromones , 2009, Adv. Eng. Softw..

[10]  Alan C. Evans,et al.  Multi-level bootstrap analysis of stable clusters in resting-state fMRI , 2009, NeuroImage.

[11]  Jun-Lin Lin,et al.  Genetic algorithm-based clustering approach for k-anonymization , 2009, Expert Syst. Appl..

[12]  Ivan Kojadinovic,et al.  Hierarchical clustering of continuous variables based on the empirical copula process and permutation linkages , 2010, Comput. Stat. Data Anal..

[13]  P. Balasubramanian,et al.  Kinetic parameter estimation in hydrocracking using hybrid particle swarm optimization , 2009 .

[14]  Luciano Lamberti,et al.  An efficient simulated annealing algorithm for design optimization of truss structures , 2008 .

[15]  Zhang Yudong,et al.  Bacterial Chemotaxis Optimization for Protein Folding Model , 2009 .

[16]  Nicolas Picard,et al.  Clustering species using a model of population dynamics and aggregation theory , 2010 .

[17]  Yudong Zhang,et al.  Find multi-objective paths in stochastic networks via chaotic immune PSO , 2010, Expert Syst. Appl..

[18]  Yudong Zhang,et al.  MAGNETIC RESONANCE BRAIN IMAGE CLASSIFICATION BY AN IMPROVED ARTIFICIAL BEE COLONY ALGORITHM , 2011 .

[19]  Aijun Liu,et al.  Improved Collaborative Particle Swarm Algorithm for Job Shop Scheduling Optimization , 2011 .

[20]  Stéphane Lecoeuche,et al.  Online clustering of switching models based on a subspace framework , 2008 .

[21]  Yudong Zhang,et al.  Spam Detection via Feature Selection and Decision Tree , 2012 .

[22]  Yudong Zhang,et al.  Chaotic Artificial Bee Colony Used for Cluster Analysis , 2011, ICIC 2011.

[23]  Yu Xu,et al.  Simulated annealing and tabu search for multi-mode project payment scheduling , 2009, Eur. J. Oper. Res..

[24]  Ran M. Bittmann,et al.  Cluster analysis using multi-algorithm voting in cross-cultural studies , 2009, Expert Syst. Appl..

[25]  M. Senthil Arumugam,et al.  A novel and effective particle swarm optimization like algorithm with extrapolation technique , 2009, Appl. Soft Comput..

[26]  C. Cotta,et al.  A memetic-aided approach to hierarchical clustering from distance matrices: application to gene expression clustering and phylogeny. , 2003, Bio Systems.

[27]  Yudong Zhang,et al.  Crop Classification by Forward Neural Network with Adaptive Chaotic Particle Swarm Optimization , 2011, Sensors.

[28]  Shihong Yue,et al.  A new separation measure for improving the effectiveness of validity indices , 2010, Inf. Sci..

[29]  Bruno Agard,et al.  A simulated annealing method based on a clustering approach to determine bills of materials for a large product family , 2009 .

[30]  Xianda Zhang,et al.  A genetic algorithm with gene rearrangement for K-means clustering , 2009, Pattern Recognit..

[31]  Yudong Zhang,et al.  A Rotation Invariant Image Descriptor based on Radon Transform , 2011 .

[32]  Ivan Kojadinovic,et al.  Agglomerative hierarchical clustering of continuous variables based on mutual information , 2004, Comput. Stat. Data Anal..

[33]  Bassem Jarboui,et al.  Combinatorial particle swarm optimization (CPSO) for partitional clustering problem , 2007, Appl. Math. Comput..

[34]  Yudong Zhang,et al.  Bacterial Foraging Optimization Based Neural Network for Short-term Load Forecasting , 2010 .

[35]  Taher Niknam,et al.  An efficient hybrid approach based on PSO, ACO and k-means for cluster analysis , 2010, Appl. Soft Comput..

[36]  Xianda Zhang,et al.  A robust dynamic niching genetic algorithm with niche migration for automatic clustering problem , 2010, Pattern Recognit..

[37]  Ickjai Lee,et al.  Unsupervised Data Mining: Introduction , 2009 .

[38]  Silvia Casado Yusta,et al.  Different metaheuristic strategies to solve the feature selection problem , 2009, Pattern Recognit. Lett..