Regular Multiple Criteria Linear Programming for Semi-supervised Classification

In this paper, inspired by the application potential of Regular Multiple Criteria Linear Programming (RMCLP), we proposed a novel Laplacian RMCLP(called Lap-RMCLP)method for semi-supervised classification problem, which can exploit the geometry information of the marginal distribution embedded in unlabeled data to construct a more reasonable classifier and is a useful extension of TSVM. Furthermore, by adjusting the parameter, Lap-RMCLP can convert to RMCLP naturally. All experiments on public and data sets and Basic Endowment Insurance Fund Audit(BEIFA) dataset show that Lap-RMCLP is a competitive method in semi-supervised classification.

[1]  M. Seeger.  Learning with labeled and unlabeled dataMatthias , 2001 .

[2]  A. N. Tikhonov,et al.  REGULARIZATION OF INCORRECTLY POSED PROBLEMS , 1963 .

[3]  Xiaojin Zhu,et al.  --1 CONTENTS , 2006 .

[4]  Yong Shi,et al.  Data Mining in Credit Card Portfolio Management: A Multiple Criteria Decision Making Approach , 2001 .

[5]  Ned Freed,et al.  EVALUATING ALTERNATIVE LINEAR PROGRAMMING MODELS TO SOLVE THE TWO-GROUP DISCRIMINANT PROBLEM , 1986 .

[6]  Xiaojun Chen,et al.  Regularized multiple criteria linear programs for classification , 2007, Seventh IEEE International Conference on Data Mining Workshops (ICDMW 2007).

[7]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[8]  Yong Shi,et al.  Robust twin support vector machine for pattern classification , 2013, Pattern Recognit..

[9]  Yong Shi,et al.  Laplacian twin support vector machine for semi-supervised classification , 2012, Neural Networks.

[10]  Yi Peng,et al.  Data Mining via Multiple Criteria Linear Programming: Applications in Credit Card Portfolio Management , 2002, Int. J. Inf. Technol. Decis. Mak..

[11]  Zoubin Ghahramani,et al.  Combining active learning and semi-supervised learning using Gaussian fields and harmonic functions , 2003, ICML 2003.

[12]  Tomaso A. Poggio,et al.  Regularization Networks and Support Vector Machines , 2000, Adv. Comput. Math..

[13]  Thorsten Joachims,et al.  Transductive Learning via Spectral Graph Partitioning , 2003, ICML.

[14]  Yong Shi,et al.  Regularized Multiple Criteria Linear Programming via Linear Programming , 2012, ICCS.

[15]  Mikhail Belkin,et al.  Using manifold structure for partially labelled classification , 2002, NIPS 2002.

[16]  Mikhail Belkin,et al.  Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples , 2006, J. Mach. Learn. Res..

[17]  Yong Shi,et al.  Twin support vector machine with Universum data , 2012, Neural Networks.

[18]  Bernhard Schölkopf,et al.  Semi-Supervised Learning (Adaptive Computation and Machine Learning) , 2006 .