Multitask multiclass privileged information support vector machines

In this paper, we propose a new learning paradigm named multitask multiclass privileged information support vector machines. The starting point of our work is mainly based on the success of multitask multiclass support vector machines which cast multitask multiclass problems as a constrained optimization problem with a quadratic objective function. Learning using privileged information is an advanced learning paradigm integrated with the idea of human teaching in machine learning. This paper mainly extends multitask multi-class support vector machines to privileged information learning strategy. Our approach can take full advantages of the multitask learning and privileged information. Experimental results show that our approaches obtains very good results for multitask multiclass problems.

[1]  Rauf Izmailov,et al.  SMO-Style Algorithms for Learning Using Privileged Information , 2010, DMIN.

[2]  Shiliang Sun,et al.  Multitask Multiclass Support Vector Machines , 2011, 2011 IEEE 11th International Conference on Data Mining Workshops.

[3]  Rich Caruana,et al.  Multitask Learning , 1998, Encyclopedia of Machine Learning and Data Mining.

[4]  Charles A. Micchelli,et al.  Learning Multiple Tasks with Kernel Methods , 2005, J. Mach. Learn. Res..

[5]  Koby Crammer,et al.  On the Algorithmic Implementation of Multiclass Kernel-based Vector Machines , 2002, J. Mach. Learn. Res..

[6]  Shiliang Sun Multitask learning for EEG-based biometrics , 2008, 2008 19th International Conference on Pattern Recognition.

[7]  Massimiliano Pontil,et al.  Regularized multi--task learning , 2004, KDD.

[8]  Kilian Q. Weinberger,et al.  Large Margin Multi-Task Metric Learning , 2010, NIPS.