Cooperative Semi-supervised Regression Algorithm based on Belief Functions Theory

Semi-supervised learning (SSL), which can exploit both labeled and unlabeled samples, has attracted a lot of research attention. Semi-supervised regression is an important content in semi-supervised learning. The traditional semi-supervised regression methods may encounter uncertainty problems in the learning process. In this paper, a cooperative semi-supervised regression method based on belief functions theory is proposed. The proposed method uses belief functions to address the uncertainty in the semi-supervised regression. The algorithm uses two belief functions based regressors and labels the unlabeled samples based on the combined results of the two regressors. The labeling confidence of an unlabeled sample is estimated through the reduction in mean squared error over the labeled neighborhood of the given sample. Experimental results show that the proposed method can effectively exploit unlabeled samples to obtain better regression performance.

[1]  R. Yager On the dempster-shafer framework and new combination rules , 1987, Inf. Sci..

[2]  Xiaoke Ma,et al.  Semi-supervised clustering algorithm for community structure detection in complex networks , 2010 .

[3]  Samy Bengio,et al.  Semi-Supervised Kernel Methods for Regression Estimation , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[4]  Huanhuan Chen,et al.  Scalable Graph-Based Semi-Supervised Learning through Sparse Bayesian Model , 2017, IEEE Transactions on Knowledge and Data Engineering.

[5]  Ayhan Demiriz,et al.  Semi-Supervised Support Vector Machines , 1998, NIPS.

[6]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[7]  Sebastian Thrun,et al.  Text Classification from Labeled and Unlabeled Documents using EM , 2000, Machine Learning.

[8]  Zhiwen Yu,et al.  Local and Global Preserving Semisupervised Dimensionality Reduction Based on Random Subspace for Cancer Classification , 2014, IEEE Journal of Biomedical and Health Informatics.

[9]  Chong Wang,et al.  A Semi-Supervised Method for Surveillance-Based Visual Location Recognition , 2017, IEEE Transactions on Cybernetics.

[10]  Zhi-Hua Zhou,et al.  Disagreement-based Semi-supervised Learning , 2013 .

[11]  Qinghua Hu,et al.  Semi-Supervised Image-to-Video Adaptation for Video Action Recognition , 2017, IEEE Transactions on Cybernetics.

[12]  Driss Aboutajdine,et al.  Support vector regression of membership functions and belief functions - Application for pattern recognition , 2010, Inf. Fusion.

[13]  Thomas Gärtner,et al.  Efficient co-regularised least squares regression , 2006, ICML.

[14]  Avrim Blum,et al.  Learning from Labeled and Unlabeled Data using Graph Mincuts , 2001, ICML.

[15]  Zhansheng Duan,et al.  Evaluation of Probability Transformations of Belief Functions for Decision Making , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[16]  Zhi-Hua Zhou,et al.  Semisupervised Regression with Cotraining-Style Algorithms , 2007, IEEE Transactions on Knowledge and Data Engineering.

[17]  Yong Qi,et al.  A Self-Training Subspace Clustering Algorithm under Low-Rank Representation for Cancer Classification on Gene Expression Data , 2018, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[18]  Thierry Denoeux,et al.  Nonparametric regression analysis of uncertain and imprecise data using belief functions , 2004, Int. J. Approx. Reason..

[19]  Naonori Ueda,et al.  A Hybrid Generative/Discriminative Approach to Semi-Supervised Classifier Design , 2005, AAAI.

[20]  Catherine K. Murphy Combining belief functions when evidence conflicts , 2000, Decis. Support Syst..

[21]  Xuelong Li,et al.  Semi-Supervised Multitask Learning for Scene Recognition , 2015, IEEE Transactions on Cybernetics.

[22]  Yi Yang,et al.  A novel approach to pre-extracting support vectors based on the theory of belief functions , 2016, Knowl. Based Syst..

[23]  Avrim Blum,et al.  The Bottleneck , 2021, Monopsony Capitalism.

[24]  Sungzoon Cho,et al.  Semi-supervised support vector regression based on self-training with label uncertainty: An application to virtual metrology in semiconductor manufacturing , 2016, Expert Syst. Appl..

[25]  Thorsten Joachims,et al.  Transductive Inference for Text Classification using Support Vector Machines , 1999, ICML.

[26]  S. Sathiya Keerthi,et al.  Optimization Techniques for Semi-Supervised Support Vector Machines , 2008, J. Mach. Learn. Res..

[27]  Jean Dezert,et al.  Credal c-means clustering method based on belief functions , 2015, Knowl. Based Syst..