A New Approach for Automatic Fuzzy Clustering Applied to Magnetic Resonance Image Clustering

Many clustering and segmentation algorithms suffer from the limitation that the number of clusters/segments is specified manually by human operators. It is often impractical to expect a human with sufficient domain knowledge to be available to select the number of clusters/segments to return. Thus, the estimation of optimal cluster number during the clustering process is our prime concern. In this paper, we introduce a new validity index method based on multi-degree entropy algorithm for determining the number of clusters automatically. This multi-degree entropy algorithm combines multi-degree immersion and entropy algorithms to partition an image into levels of intensity. The output of the multi-degree immersion processes are regions in which the interior does not contain any sharp grey value transitions, i.e. each level of intensity contains one or more regions of connected points or oversegmentation. These regions are passed to the entropy procedure to perform a suitable merging which produces the final number of clusters based on validity function criteria. Validity functions are used to find a relation between intra-cluster and inter-cluster variability, which is of course a reasonable principle. The latter process uses a region-based similarity representation of the image regions to decide whether regions can be merged. The proposed method is experimented on a discrete image example to prove its efficiency and applicability. The existing validation indices like PC, XB, and CE are evaluated and compared with the proposed index when applied on two simulation and one real life data. A direct benefit of this method is being able to determine the number of clusters for given application medical images.

[1]  R. Kruse,et al.  An extension to possibilistic fuzzy cluster analysis , 2004, Fuzzy Sets Syst..

[2]  Çagdas Hakan Aladag,et al.  Determining the most proper number of cluster in fuzzy clustering by using artificial neural networks , 2011, Expert Syst. Appl..

[3]  Ramachandran Baskaran,et al.  A Survey on Internal Validity Measure for Cluster Validation , 2010 .

[4]  Dao-Qiang Zhang,et al.  A novel kernelized fuzzy C-means algorithm with application in medical image segmentation , 2004, Artif. Intell. Medicine.

[5]  Boudewijn P. F. Lelieveldt,et al.  A new cluster validity index for the fuzzy c-mean , 1998, Pattern Recognit. Lett..

[6]  Ujjwal Maulik,et al.  Fuzzy partitioning using a real-coded variable-length genetic algorithm for pixel classification , 2003, IEEE Trans. Geosci. Remote. Sens..

[7]  Richard G. Brereton,et al.  A Comparative Study of Cluster Validation Indices Applied to Genotyping Data , 2005 .

[8]  Zexuan Ji,et al.  A modified possibilistic fuzzy c-means clustering algorithm for bias field estimation and segmentation of brain MR image , 2011, Comput. Medical Imaging Graph..

[9]  Ujjwal Maulik,et al.  Validity index for crisp and fuzzy clusters , 2004, Pattern Recognit..

[10]  Korris Fu-Lai Chung,et al.  Generalized Fuzzy C-Means Clustering Algorithm With Improved Fuzzy Partitions , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[11]  J. Bezdek Numerical taxonomy with fuzzy sets , 1974 .

[12]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[13]  Lawrence O. Hall,et al.  Kernel Based Fuzzy Ant Clustering with Partition Validity , 2006, 2006 IEEE International Conference on Fuzzy Systems.

[14]  Miin-Shen Yang,et al.  A cluster validity index for fuzzy clustering , 2005, Pattern Recognit. Lett..

[15]  Lequan Min,et al.  Novel modified fuzzy c-means algorithm with applications , 2009, Digit. Signal Process..

[16]  P. Mikołajczak,et al.  Information theory based medical images processing , 2003 .

[17]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[18]  Aly A. Farag,et al.  On Cluster Validity Indexes in Fuzzy and Hard Clustering Algorithms for Image Segmentation , 2007, 2007 IEEE International Conference on Image Processing.

[19]  Dong-Jo Park,et al.  A Novel Validity Index for Determination of the Optimal Number of Clusters , 2001 .

[20]  Gerardo Beni,et al.  A Validity Measure for Fuzzy Clustering , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Ujjwal Maulik,et al.  A study of some fuzzy cluster validity indices, genetic clustering and application to pixel classification , 2005, Fuzzy Sets Syst..

[22]  Doheon Lee,et al.  A kernel-based subtractive clustering method , 2005, Pattern Recognit. Lett..

[23]  Aly A. Farag,et al.  A modified fuzzy c-means algorithm for bias field estimation and segmentation of MRI data , 2002, IEEE Transactions on Medical Imaging.

[24]  Z. Volkovich,et al.  A statistical model of cluster stability , 2008, Pattern Recognit..

[25]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[26]  Jiang-She Zhang,et al.  Improved possibilistic C-means clustering algorithms , 2004, IEEE Trans. Fuzzy Syst..

[27]  Hong Yan,et al.  Cluster analysis of gene expression data based on self-splitting and merging competitive learning , 2004, IEEE Transactions on Information Technology in Biomedicine.

[28]  Kyung-Whan Oh,et al.  A validity measure for fuzzy clustering and its use in selecting optimal number of clusters , 1996, Proceedings of IEEE 5th International Fuzzy Systems.

[29]  Sultan Aljahdali,et al.  A kernelized fuzzy c-means algorithm for automatic magnetic resonance image segmentation , 2009, J. Comput. Methods Sci. Eng..

[30]  Gabriella Sanniti di Baja,et al.  Oversegmentation reduction in watershed-based grey-level image segmentation , 2008 .