Calibrated Rank-SVM for multi-label image categorization

In the area of multi-label image categorization, there are two important issues: label classification and label ranking. The former refers to whether a label is relevant or not, and the latter refers to what extent a label is relevant to an image. However, few existing papers have considered them in a holistic way. In this paper we will suggest a concrete improved method, named calibrated RankSVM, to bridge the gap between multi-label classification and label ranking. Through incorporating a virtual label as a calibrated scale, the threshold selection stage is embedded into ranking learning stage. This holistic way is essentially different from conventional rank methods, making our proposed method more suitable for multi-label classification task. The experiments on image have demonstrated that our algorithm has better multi-label classification performances than conventional RankSVM while preserving its good ranking characteristics.

[1]  Yoram Singer,et al.  BoosTexter: A Boosting-based System for Text Categorization , 2000, Machine Learning.

[2]  Jiebo Luo,et al.  Learning multi-label scene classification , 2004, Pattern Recognit..

[3]  Zhi-Hua Zhou,et al.  Multi-Instance Multi-Label Learning with Application to Scene Classification , 2006, NIPS.

[4]  Eyke Hüllermeier,et al.  A Unified Model for Multilabel Classification and Ranking , 2006, ECAI.

[5]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[6]  Yi Liu,et al.  Semi-supervised Multi-label Learning by Constrained Non-negative Matrix Factorization , 2006, AAAI.

[7]  John Hallam,et al.  IEEE International Joint Conference on Neural Networks , 2005 .

[8]  Koby Crammer,et al.  A Family of Additive Online Algorithms for Category Ranking , 2003, J. Mach. Learn. Res..

[9]  Yihong Gong,et al.  Multi-labelled classification using maximum entropy method , 2005, SIGIR '05.

[10]  Jason Weston,et al.  A kernel method for multi-labelled classification , 2001, NIPS.

[11]  Tao Mei,et al.  Correlative multi-label video annotation , 2007, ACM Multimedia.

[12]  Edward Y. Chang,et al.  CBSA: content-based soft annotation for multimodal image retrieval using Bayes point machines , 2003, IEEE Trans. Circuits Syst. Video Technol..

[13]  Yiming Yang,et al.  A re-examination of text categorization methods , 1999, SIGIR '99.

[14]  Jason Weston,et al.  Kernel methods for Multi-labelled classification and Categ orical regression problems , 2001, NIPS 2001.

[15]  Philip Wolfe,et al.  An algorithm for quadratic programming , 1956 .