Gradient based fuzzy c-means (GBFCM) algorithm

In this paper, a clustering algorithm based on the fuzzy c-means algorithm (FCM) and the gradient descent method is presented. In the FCM, the minimization process of the objective function is proceeded by solving two equations alternatively in an iterative fashion. Each iteration requires the use of all the data at once. In our proposed approach one datum at a time is presented to the network, and the minimization is proceeded using the gradient descent method. Compared to FCM, the experimental results show that our algorithm is very competitive in terms of speed and stability of convergence for large number of data.<<ETX>>

[1]  Michael P. Windham,et al.  Cluster Validity for the Fuzzy c-Means Clustering Algorithrm , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  George J. Klir,et al.  Fuzzy sets, uncertainty and information , 1988 .

[3]  James C. Bezdek,et al.  Optimal Fuzzy Partitions: A Heuristic for Estimating the Parameters in a Mixture of Normal Distributions , 1975, IEEE Transactions on Computers.

[4]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[5]  J. C. Dunn,et al.  A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters , 1973 .

[6]  Gerardo Beni,et al.  A Validity Measure for Fuzzy Clustering , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[8]  James C. Bezdek,et al.  A Convergence Theorem for the Fuzzy ISODATA Clustering Algorithms , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Isak Gath,et al.  Unsupervised Optimal Fuzzy Clustering , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  M. P. Windham Cluster validity for fuzzy clustering algorithms , 1981 .

[11]  Joel Weisman,et al.  Introduction to optimization theory , 1973 .