A semi-supervised learning approach for soft labeled data

In some machine learning applications using soft labels is more useful and informative than crisp labels. Soft labels indicate the degree of membership of the training data to the given classes. Often only a small number of labeled data is available while unlabeled data is abundant. Therefore, it is important to make use of unlabeled data. In this paper we propose an approach for Fuzzy-Input Fuzzy-Output classification in which the classifier can learn with soft-labeled data and can also produce degree of belongingness to classes as an output for each pattern. Particularly, we investigate the case where only a few soft labels are available and data can be represented by different views. We investigate two semi-supervised multiple classifier frameworks for this classification purpose. Results show that semi supervised multiple classifiers can improve the performance of fuzzy classification by making use of the unlabeled data.

[1]  Fabio Gagliardi Cozman,et al.  Semi-supervised Learning of Classifiers : Theory , Algorithms and Their Application to Human-Computer Interaction , 2004 .

[2]  Nicu Sebe,et al.  Semisupervised learning of classifiers: theory, algorithms, and their application to human-computer interaction , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Qiong Jackson,et al.  An adaptive classifier design for high-dimensional data analysis with a limited training data set , 2001, IEEE Trans. Geosci. Remote. Sens..

[4]  James M. Keller,et al.  Incorporating Fuzzy Membership Functions into the Perceptron Algorithm , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Ludmila I. Kuncheva,et al.  Fuzzy Classifier Design , 2000, Studies in Fuzziness and Soft Computing.

[6]  M. Zusi,et al.  A fuzzy-input fuzzy-output SVM technique for classification of hyperspectral remote sensing images , 2006, Proceedings of the 7th Nordic Signal Processing Symposium - NORSIG 2006.

[7]  Neamat El Gayar,et al.  New Feature Splitting Criteria for Co-training Using Genetic Algorithm Optimization , 2010, MCS.

[8]  Friedhelm Schwenker,et al.  Experiments with Supervised Fuzzy LVQ , 2008, ANNPR.

[9]  James M. Keller,et al.  A fuzzy K-nearest neighbor algorithm , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[10]  Amir F. Atiya,et al.  Fuzzy Gaussian Process Classification Model , 2009, ICIAR.

[11]  Gian Luca Marcialis,et al.  Adaptive Biometric Systems That Can Improve with Use , 2008 .

[12]  Neamat El Gayar,et al.  Face recognition with co-training and ensemble-driven learning , 2007 .

[13]  Fabio Roli,et al.  Using Co-training and Self-training in Semi-supervised Multiple Classifier Systems , 2006, SSPR/SPR.

[14]  Günther Palm,et al.  A Study of the Robustness of KNN Classifiers Trained Using Soft Labels , 2006, ANNPR.

[15]  Friedhelm Schwenker,et al.  Learning Object Recognition in a NeuroBotic System , 2004 .

[16]  Rebecca Fay,et al.  Feature selection and information fusion in hierarchical neural networks for iterative 3D-object recognition , 2007 .

[17]  Neamat El Gayar An Experimental Study of a Self-Supervised Classifier Ensemble , 2004, International Conference on Computational Intelligence.

[18]  Christian Thiel,et al.  Classification on Soft Labels Is Robust against Label Noise , 2008, KES.

[19]  Elmar Nöth,et al.  "Of all things the measure is man" automatic classification of emotions and inter-labeler consistency [speech-based emotion recognition] , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[20]  Olac Fuentes,et al.  Face Recognition Using Unlabeled Data , 2003, Computación y Sistemas.

[21]  Friedhelm Schwenker,et al.  Fuzzy-Input Fuzzy-Output One-Against-All Support Vector Machines , 2007, KES.

[22]  Salvatore J. Stolfo,et al.  Data mining-based intrusion detectors: an overview of the columbia IDS project , 2001, SGMD.

[23]  Xiaojin Zhu,et al.  --1 CONTENTS , 2006 .