A study on statistical mechanical characteristics of fuzzy clustering

This paper is dealing with the fuzzy clustering method which combines the deterministic annealing approach and the fuzzy entropy. Regularizing fuzzy c-Means with the fuzzy entropy, we obtain the Fermi-Dirac type distribution function as the membership function. Then we examine the meanings of Fermi-Dirac function and the fuzzy entropy from the statistical mechanical point of view, and show that the mechanism of this fuzzy clustering is no other than the Fermi-Dirac statistics. Also we propose the algorithm which performs deterministic annealing of the membership function. Numerical experiment demonstrates that the proposed method can cluster a given set of data points properly.

[1]  Luigi Cinque,et al.  Image thresholding using fuzzy entropies , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[2]  Geoffrey C. Fox,et al.  Constrained Clustering as an Optimization Method , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[4]  Settimo Termini,et al.  A Definition of a Nonprobabilistic Entropy in the Setting of Fuzzy Sets Theory , 1972, Inf. Control..

[5]  James C. Bezdek,et al.  Measuring fuzzy uncertainty , 1994, IEEE Trans. Fuzzy Syst..

[6]  Kenneth Rose,et al.  A global optimization technique for statistical classifier design , 1996, IEEE Trans. Signal Process..

[7]  N. Ueda,et al.  Mixture density estimation via EM algorithm with deterministic annealing , 1994, Proceedings of IEEE Workshop on Neural Networks for Signal Processing.

[8]  Bill P. Buckles,et al.  Information-theoretical characterization of fuzzy relational databases , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[9]  Rui-Ping Li,et al.  A maximum-entropy approach to fuzzy clustering , 1995, Proceedings of 1995 IEEE International Conference on Fuzzy Systems..

[10]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[11]  Nikhil R. Pal On quantification of different facets of uncertainty , 1999, Fuzzy Sets Syst..

[12]  K. Rose Deterministic annealing for clustering, compression, classification, regression, and related optimization problems , 1998, Proc. IEEE.