Objective function of semi-supervised Fuzzy C-Means clustering algorithm

Analyzed here is the physical interpretation of objective function of semi-supervised fuzzy C-means (SS-FCM) algorithm and its coefficient alpha. A conclusion-Stutzpsilas modification to the objective function of Pedrycz is much clearer: unlabeled samples involves in unsupervised learning of FCM, labeled samples involves in unsupervised learning with coefficient (1-a) and participate in supervised learning with a, and when a=1 or 0, the SS-FCM degrades to FCM-is illustrated. The corresponding alternately optimizing algorithm of SS-FCM with fuzzy covariance is provided. The experimental results show that: 1) Modified algorithm has the same semi-supervised role and has much clearer physical interpretation. 2) Using FCM algorithm to assign membership for labeled samples is better than using random number. 3) SS-FCM with fuzzy covariance and a small number of well-selected labeled samples can effectively improve the accuracy and convergence speed.

[1]  Witold Pedrycz,et al.  Algorithms of fuzzy clustering with partial supervision , 1985, Pattern Recognit. Lett..

[2]  Witold Pedrycz,et al.  Data Clustering with Partial Supervision , 2005, Data Mining and Knowledge Discovery.

[3]  Abdelhamid Bouchachia Learning with hybrid data , 2005, Fifth International Conference on Hybrid Intelligent Systems (HIS'05).

[4]  Thomas A. Runkler,et al.  Classification and prediction of road traffic using application-specific fuzzy clustering , 2002, IEEE Trans. Fuzzy Syst..

[5]  Witold Pedrycz,et al.  Neural-network front ends in unsupervised learning , 1997, IEEE Trans. Neural Networks.

[6]  Arindam Banerjee,et al.  Semi-supervised Clustering by Seeding , 2002, ICML.

[7]  Donald Gustafson,et al.  Fuzzy clustering with a fuzzy covariance matrix , 1978, 1978 IEEE Conference on Decision and Control including the 17th Symposium on Adaptive Processes.

[8]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[9]  Ronald Rosenfeld,et al.  Semi-supervised learning with graphs , 2005 .

[10]  Witold Pedrycz,et al.  Fuzzy clustering with partial supervision , 1997, IEEE Trans. Syst. Man Cybern. Part B.