Dynamic fuzzy clustering using Harmony Search with application to image segmentation

In this paper, a new dynamic clustering approach based on the Harmony Search algorithm (HS) called DCHS is proposed. In this algorithm, the capability of standard HS is modified to automatically evolve the appropriate number of clusters as well as the locations of cluster centers. By incorporating the concept of variable length in each harmony memory vector, DCHS is able to encode variable numbers of candidate cluster centers at each iteration. The PBMF cluster validity index is used as an objective function to validate the clustering result obtained from each harmony memory vector. The proposed approach has been applied onto well known natural images and experimental results show that DCHS is able to find the appropriate number of clusters and locations of cluster centers. This approach has also been compared with other metaheuristic dynamic clustering techniques and has shown to be very promising.

[1]  Miao Qi,et al.  A Modified FCM Algorithm for MRI Brain Image Segmentation , 2008, 2008 International Seminar on Future BioMedical Information Engineering.

[2]  Swagatam Das,et al.  Automatic Clustering Using an Improved Differential Evolution Algorithm , 2007 .

[3]  Javier Rodeiro Iglesias,et al.  S-means : Similarity Driven Clustering and Its application in Gravitational-Wave Astronomy Data Mining , 2007 .

[4]  Greg Hamerly,et al.  Learning the k in k-means , 2003, NIPS.

[5]  Greg Hamerly,et al.  PG-means: learning the number of clusters in data , 2006, NIPS.

[6]  Andrew W. Moore,et al.  X-means: Extending K-means with Efficient Estimation of the Number of Clusters , 2000, ICML.

[7]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[8]  Alex Alves Freitas,et al.  A Survey of Evolutionary Algorithms for Clustering , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[9]  P. Sopp.  Cluster analysis. , 1996, Veterinary immunology and immunopathology.

[10]  Ping Wang,et al.  A Modified FCM Algorithm for MRI Brain Image Segmentation , 2008 .

[11]  Zong Woo Geem,et al.  A New Heuristic Optimization Algorithm: Harmony Search , 2001, Simul..

[12]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Brian Everitt,et al.  Cluster analysis , 1974 .

[14]  Emanuel Falkenauer,et al.  Genetic Algorithms and Grouping Problems , 1998 .

[15]  Ujjwal Maulik,et al.  A study of some fuzzy cluster validity indices, genetic clustering and application to pixel classification , 2005, Fuzzy Sets Syst..

[16]  James C. Bezdek,et al.  Local convergence of the fuzzy c-Means algorithms , 1986, Pattern Recognit..

[17]  S. R. Kannan,et al.  A new segmentation system for brain MR images based on fuzzy techniques , 2008, Appl. Soft Comput..

[18]  Shokri Z. Selim,et al.  K-Means-Type Algorithms: A Generalized Convergence Theorem and Characterization of Local Optimality , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Michalis Vazirgiannis,et al.  c ○ 2001 Kluwer Academic Publishers. Manufactured in The Netherlands. On Clustering Validation Techniques , 2022 .

[20]  K. Lee,et al.  A new meta-heuristic algorithm for continuous engineering optimization: harmony search theory and practice , 2005 .

[21]  G H Ball,et al.  A clustering technique for summarizing multivariate data. , 1967, Behavioral science.

[22]  Aly A. Farag,et al.  On Cluster Validity Indexes in Fuzzy and Hard Clustering Algorithms for Image Segmentation , 2007, 2007 IEEE International Conference on Image Processing.

[23]  Ujjwal Maulik,et al.  Validity index for crisp and fuzzy clusters , 2004, Pattern Recognit..

[24]  E. Dubois,et al.  Digital picture processing , 1985, Proceedings of the IEEE.

[25]  Ricardo J. G. B. Campello,et al.  On the efficiency of evolutionary fuzzy clustering , 2009, J. Heuristics.

[26]  Christophe Rosenberger,et al.  Unsupervised clustering method with optimal estimation of the number of clusters: application to image segmentation , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[27]  Lior Rokach,et al.  Soft Computing for Knowledge Discovery and Data Mining , 2007 .

[28]  Ujjwal Maulik,et al.  Fuzzy partitioning using a real-coded variable-length genetic algorithm for pixel classification , 2003, IEEE Trans. Geosci. Remote. Sens..

[29]  Rajesh N. Davé,et al.  Robust clustering methods: a unified view , 1997, IEEE Trans. Fuzzy Syst..

[30]  Zong Woo Geem,et al.  Music-Inspired Harmony Search Algorithm , 2009 .

[31]  Andries Petrus Engelbrecht,et al.  Dynamic clustering using particle swarm optimization with application in image segmentation , 2006, Pattern Analysis and Applications.

[32]  Ujjwal Maulik,et al.  Genetic clustering for automatic evolution of clusters and application to image classification , 2002, Pattern Recognit..

[33]  Amit Konar,et al.  Automatic image pixel clustering with an improved differential evolution , 2009, Appl. Soft Comput..

[34]  Lequan Min,et al.  Novel modified fuzzy c-means algorithm with applications , 2009, Digit. Signal Process..

[35]  Hichem Frigui,et al.  A Robust Competitive Clustering Algorithm With Applications in Computer Vision , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Weina Wang,et al.  On fuzzy cluster validity indices , 2007, Fuzzy Sets Syst..

[37]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.