Semi-supervised Fuzzy Relational Classifier

Recently, semi-supervised learning has attracted much attention, and it is applicable to both clustering and classification. But among a large number of these algorithms, only a few considered combining semi-supervised clustering and classification together. However, in supervised learning, the fuzzy relational classifier (FRC) is a recently proposed two-step nonlinear classifier which combines the unsupervised clustering and supervised classification together. Inspired from FRC, in this paper, we present a new method, called Semi-supervised Fuzzy Relational Classifier (SSFRC), which combines semi-supervised clustering and classification together. In the proposed SSFRC, we employ the semi-supervised pair wise-constrained competitive agglomeration (PCCA) to replace FCM to obtain clusters fitting user expectations without specifying the exact cluster number. In addition, we incorporate the fuzzy class labels of unlabeled data into the classification mechanism to improve its performance. The experimental results on real-life datasets demonstrate that SSFRC can outperform FRC with all data labeled in classification performance.

[1]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[2]  Avrim Blum,et al.  The Bottleneck , 2021, Monopsony Capitalism.

[3]  Jing Lu,et al.  Semi-supervised fuzzy clustering: A kernel-based approach , 2009, Knowl. Based Syst..

[4]  James C. Bezdek,et al.  Partially supervised clustering for image segmentation , 1996, Pattern Recognit..

[5]  Dimitar P. Filev,et al.  Fuzzy SETS AND FUZZY LOGIC , 1996 .

[6]  Witold Pedrycz,et al.  Fuzzy clustering with partial supervision , 1997, IEEE Trans. Syst. Man Cybern. Part B.

[7]  Ayhan Demiriz,et al.  Semi-Supervised Support Vector Machines , 1998, NIPS.

[8]  Hichem Frigui,et al.  Clustering by competitive agglomeration , 1997, Pattern Recognit..

[9]  Arindam Banerjee,et al.  Semi-supervised Clustering by Seeding , 2002, ICML.

[10]  Siegfried Gottwald,et al.  Fuzzy Sets and Fuzzy Logic , 1993 .

[11]  Xiaojin Zhu,et al.  --1 CONTENTS , 2006 .

[12]  Mohamad T. Musavi,et al.  On the training of radial basis function classifiers , 1992, Neural Networks.

[13]  Gerardo Beni,et al.  A Validity Measure for Fuzzy Clustering , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  James M. Keller,et al.  A fuzzy K-nearest neighbor algorithm , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[15]  Tommi S. Jaakkola,et al.  Partially labeled classification with Markov random walks , 2001, NIPS.

[16]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[17]  Magne Setnes,et al.  Fuzzy relational classifier trained by fuzzy clustering , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[18]  Daoqiang Zhang,et al.  Robust fuzzy relational classifier incorporating the soft class labels , 2007, Pattern Recognit. Lett..

[19]  Nozha Boujemaa,et al.  Semi-Supervised Fuzzy Clustering with Pairwise-Constrained Competitive Agglomeration , 2005, The 14th IEEE International Conference on Fuzzy Systems, 2005. FUZZ '05..

[20]  Claire Cardie,et al.  Proceedings of the Eighteenth International Conference on Machine Learning, 2001, p. 577–584. Constrained K-means Clustering with Background Knowledge , 2022 .

[21]  Witold Pedrycz,et al.  Fuzzy clustering with supervision , 2004, Pattern Recognit..