Fuzzy clustering with volume prototypes and adaptive cluster merging

Two extensions to objective function-based fuzzy clustering are proposed. First, the (point) prototypes are extended to hypervolumes, whose size can be fixed or can be determined automatically from the data being clustered. It is shown that clustering with hypervolume prototypes can be formulated as the minimization of an objective function. Second, a heuristic cluster merging step is introduced where the similarity among the clusters is assessed during optimization. Starting with an overestimation of the number of clusters in the data, similar clusters are merged in order to obtain a suitable partitioning. An adaptive threshold for merging is proposed. The extensions proposed are applied to Gustafson-Kessel and fuzzy c-means algorithms, and the resulting extended algorithm is given. The properties of the new algorithm are illustrated by various examples.

[1]  U. Kaymak,et al.  Compatible cluster merging for fuzzy modelling , 1995, Proceedings of 1995 IEEE International Conference on Fuzzy Systems..

[2]  Donald Gustafson,et al.  Fuzzy clustering with a fuzzy covariance matrix , 1978, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[3]  Gerardo Beni,et al.  A Validity Measure for Fuzzy Clustering , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[5]  Jongwoo Kim,et al.  Clustering algorithms based on volume criteria , 2000, IEEE Trans. Fuzzy Syst..

[6]  Hichem Frigui,et al.  A robust algorithm for automatic extraction of an unknown number of clusters from noisy data , 1996, Pattern Recognit. Lett..

[7]  Magne Setnes,et al.  Fuzzy modeling of client preference from large data sets: an application to target selection in direct marketing , 2001, IEEE Trans. Fuzzy Syst..

[8]  Uzay Kaymak,et al.  A sensitivity analysis approach to introducing weight factors into decision functions in fuzzy multicriteria decision making , 1998, Fuzzy Sets Syst..

[9]  A. Keller,et al.  Clustering with Volume Adaption for Rule Learning , 1999 .

[10]  V. J. Rayward-Smith,et al.  Fuzzy Cluster Analysis: Methods for Classification, Data Analysis and Image Recognition , 1999 .

[11]  W. Peizhuang Pattern Recognition with Fuzzy Objective Function Algorithms (James C. Bezdek) , 1983 .

[12]  Shigeo Abe,et al.  Neural Networks and Fuzzy Systems , 1996, Springer US.

[13]  Christopher J. Merz,et al.  UCI Repository of Machine Learning Databases , 1996 .

[14]  Magne Setnes,et al.  Supervised fuzzy clustering for rule extraction , 1999, FUZZ-IEEE'99. 1999 IEEE International Fuzzy Systems. Conference Proceedings (Cat. No.99CH36315).

[15]  J. C. Dunn,et al.  A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters , 1973 .

[16]  Anil K. Jain,et al.  A Clustering Performance Measure Based on Fuzzy Set Decomposition , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Isak Gath,et al.  Unsupervised Optimal Fuzzy Clustering , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Raghu Krishnapuram,et al.  Fitting an unknown number of lines and planes to image data through compatible cluster merging , 1992, Pattern Recognit..

[19]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .