A hybrid clustering algorithm based on PSO with dynamic crossover

In order to overcome the premature convergence in particle swarm optimization (PSO), we introduce dynamical crossover, a crossover operator with variable lengths and positions, to PSO, which is briefly denoted as CPSO. To get rid of the drawbacks of only finding the convex clusters and being sensitive to the initial points in $$k$$k-means algorithm, a hybrid clustering algorithm based on CPSO is proposed. The difference between the work and the existing ones lies in that CPSO is firstly introduced into $$k$$k-means. Experimental results performing on several data sets illustrate that the proposed clustering algorithm can get completely rid of the shortcomings of $$k$$k-means algorithms, and acquire correct clustering results. The application in image segmentation illustrates that the proposed algorithm gains good performance.

[1]  Jing Li,et al.  A new hybrid method based on partitioning-based DBSCAN and ant clustering , 2011, Expert Syst. Appl..

[2]  Hillol Kargupta,et al.  Approximate Distributed K-Means Clustering over a Peer-to-Peer Network , 2009, IEEE Transactions on Knowledge and Data Engineering.

[3]  Nihan Çetin Demirel,et al.  A new geometric shape-based genetic clustering algorithm for the multi-depot vehicle routing problem , 2011, Expert Syst. Appl..

[4]  Jiawei Han,et al.  Data Mining: Concepts and Techniques , 2000 .

[5]  Xiaofeng Wang,et al.  A Novel Density-Based Clustering Framework by Using Level Set Method , 2009, IEEE Transactions on Knowledge and Data Engineering.

[6]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[7]  Chien-Liang Liu,et al.  Clustering tagged documents with labeled and unlabeled documents , 2013, Inf. Process. Manag..

[8]  Linda G. Shapiro,et al.  Image Segmentation Techniques , 1984, Other Conferences.

[9]  Dingxi Qiu,et al.  A comparative study of the K-means algorithm and the normal mixture model for clustering: Bivariate homoscedastic case , 2010 .

[10]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[11]  Ki-Sang Hong,et al.  Image Segmentation by Unsupervised Sparse Clustering , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[12]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[13]  Nong Sang,et al.  Using clustering analysis to improve semi-supervised classification , 2013, Neurocomputing.

[14]  Rongchun Zhao,et al.  Image segmentation by clustering of spatial patterns , 2007, Pattern Recognit. Lett..

[15]  Stan Jarzabek,et al.  A Data Mining Approach for Detecting Higher-Level Clones in Software , 2009, IEEE Transactions on Software Engineering.

[16]  Kamran Behdinan,et al.  Data Mining based mutation function for engineering problems with mixed continuous-discrete design variables , 2010 .

[17]  Sanjay Ranka,et al.  An effic ient k-means clustering algorithm , 1997 .

[18]  Chris H. Q. Ding,et al.  Spectral Relaxation for K-means Clustering , 2001, NIPS.

[19]  Jitendra Malik,et al.  Normalized Cuts and Image Segmentation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Daoqiang Zhang,et al.  Robust image segmentation using FCM with spatial constraints based on new kernel-induced distance measure , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[21]  Jinxin Dong,et al.  A New Algorithm for Clustering Based on Particle Swarm Optimization and K-means , 2009, 2009 International Conference on Artificial Intelligence and Computational Intelligence.

[22]  S. S. Ravi,et al.  Using instance-level constraints in agglomerative hierarchical clustering: theoretical and empirical results , 2009, Data Mining and Knowledge Discovery.

[23]  Jian Jhen Chen,et al.  K-means clustering versus validation measures: a data-distribution perspective. , 2009, IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society.

[24]  Xiangtao Li,et al.  A novel hybrid K-harmonic means and gravitational search algorithm approach for clustering , 2011, Expert Syst. Appl..

[25]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[26]  Gajski,et al.  Guest Editors' Introduction: New VLSI Tools , 1983, Computer.

[27]  Derya Birant,et al.  ST-DBSCAN: An algorithm for clustering spatial-temporal data , 2007, Data Knowl. Eng..

[28]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[29]  Ming Dong,et al.  Multi-level Low-rank Approximation-based Spectral Clustering for image segmentation , 2012, Pattern Recognit. Lett..

[30]  Shuiping Gou,et al.  Parallel Sparse Spectral Clustering for SAR Image Segmentation , 2013, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[31]  Ira Assent,et al.  Clustering multidimensional sequences in spatial and temporal databases , 2007, Knowledge and Information Systems.

[32]  Hassan Abolhassani,et al.  Harmony K-means algorithm for document clustering , 2009, Data Mining and Knowledge Discovery.

[33]  Morteza Haghir Chehreghani,et al.  Improving density-based methods for hierarchical clustering of web pages , 2008, Data Knowl. Eng..

[34]  Junyi Shen,et al.  A Fast K-Means Clustering Algorithm Based on Grid Data Reduction , 2008, 2008 IEEE Aerospace Conference.

[35]  B. S. Manjunath,et al.  Edge flow: A framework of boundary detection and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[36]  Rehab F. Abdel-Kader.  Genetically Improved PSO Algorithm for Efficient Data Clustering , 2010, 2010 Second International Conference on Machine Learning and Computing.

[37]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[38]  Jie Zhang,et al.  The Particle Swarm Optimization Algorithm Based on Dynamic Chaotic Perturbations and its Application to K-Means , 2009, 2009 International Conference on Computational Intelligence and Security.

[39]  Tzong-Jer Chen,et al.  Fuzzy c-means clustering with spatial information for image segmentation , 2006, Comput. Medical Imaging Graph..

[40]  Jie Zhang,et al.  Class Assignment Algorithms for Performance Measure of Clustering Algorithms , 2012, 2012 Eighth International Conference on Computational Intelligence and Security.

[41]  M. Karthikeyan,et al.  Probability based document clustering and image clustering using content-based image retrieval , 2013, Appl. Soft Comput..

[42]  V. Mankar,et al.  Colour Image Segmentation - A Survey , 2013 .

[43]  Daoqiang Zhang,et al.  Fast and robust fuzzy c-means clustering algorithms incorporating local information for image segmentation , 2007, Pattern Recognit..

[44]  Yuping Wang,et al.  Attribute Index and Uniform Design Based Multiobjective Association Rule Mining with Evolutionary Algorithm , 2013, TheScientificWorldJournal.

[45]  Nacéra Bennacer,et al.  Context-based Hierarchical Clustering for the Ontology Learning , 2006, 2006 IEEE/WIC/ACM International Conference on Web Intelligence (WI 2006 Main Conference Proceedings)(WI'06).