Extended Fuzzy Clustering Algorithms

Fuzzy clustering is a widely applied method for obtaining fuzzy models from data. It has been applied successfully in various fields including finance and marketing. Despite the successful applications, there are a number of issues that must be dealt with in practical applications of fuzzy clustering algorithms. This technical report proposes two extensions to the objective function based fuzzy clustering for dealing with these issues. First, the (point) prototypes are extended to hypervolumes whose size is determined automatically from the data being clustered. These prototypes are shown to be less sensitive to a bias in the distribution of the data. Second, cluster merging by assessing the similarity among the clusters during optimization is introduced. Starting with an over-estimated number of clusters in the data, similar clusters are merged during clustering in order to obtain a suitable partitioning of the data. An adaptive threshold for merging is introduced. The proposed extensions are applied to Gustafson-Kessel and fuzzy c-means algorithms, and the resulting extended algorithms are given. The properties of the new algorithms are illustrated in various examples.

[1]  J. C. Dunn,et al.  A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters , 1973 .

[2]  Donald Gustafson,et al.  Fuzzy clustering with a fuzzy covariance matrix , 1978, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[3]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[4]  W. Peizhuang.  Pattern Recognition with Fuzzy Objective Function Algorithms (James C. Bezdek) , 1983 .

[5]  H. R. van Nauta Lemke,et al.  A Characteristic Optimism Factor in Fuzzy Decision-Making , 1983 .

[6]  Isak Gath,et al.  Unsupervised Optimal Fuzzy Clustering , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Gerardo Beni,et al.  A Validity Measure for Fuzzy Clustering , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Raghu Krishnapuram.  Generation of membership functions via possibilistic clustering , 1994, Proceedings of 1994 IEEE 3rd International Fuzzy Systems Conference.

[9]  U. Kaymak,et al.  Compatible cluster merging for fuzzy modelling , 1995, Proceedings of 1995 IEEE International Conference on Fuzzy Systems..

[10]  Robert Babuska,et al.  Methods for Simplification of Fuzzy Models , 1997 .

[11]  Uzay Kaymak,et al.  Fuzzy target selection in direct marketing , 1998, Proceedings of the IEEE/IAFE/INFORMS 1998 Conference on Computational Intelligence for Financial Engineering (CIFEr) (Cat. No.98TH8367).

[12]  Uzay Kaymak,et al.  A sensitivity analysis approach to introducing weight factors into decision functions in fuzzy multicriteria decision making , 1998, Fuzzy Sets Syst..

[13]  Uzay Kaymak,et al.  Similarity measures in fuzzy rule base simplification , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[14]  Magne Setnes,et al.  Rule-based modeling: precision and transparency , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[15]  Magne Setnes,et al.  Supervised fuzzy clustering for rule extraction , 1999, FUZZ-IEEE'99. 1999 IEEE International Fuzzy Systems. Conference Proceedings (Cat. No.99CH36315).

[16]  James M. Keller,et al.  Will the real iris data please stand up? , 1999, IEEE Trans. Fuzzy Syst..

[17]  Laszlo Polos,et al.  The Strawberry Growth Underneath the Nettle: The Emergence of Entrepreneurs in China , 2000 .

[18]  Jongwoo Kim,et al.  Clustering algorithms based on volume criteria , 2000, IEEE Trans. Fuzzy Syst..

[19]  Berend Wierenga,et al.  The Powerful Triangle of Marketing Data, Managerial Judgment, and Marketing Management Support Systems , 2000 .

[20]  M. Carree,et al.  The Evolution of the Russian Saving Bank Sector During the Transition Era , 2000 .

[21]  Magne Setnes,et al.  Fuzzy modeling of client preference from large data sets: an application to target selection in direct marketing , 2001, IEEE Trans. Fuzzy Syst..