Online Multi-label Passive Aggressive Active Learning Algorithm Based on Binary Relevance

Online multi-label learning is an efficient classification paradigm in machine learning. However, traditional online multi-label methods often need requesting all class labels of each incoming sample, which is often human cost and time-consuming in labeling classification problem. In order to tackle these problems, in this paper, we present online multi-label passive aggressive active (MLPAA) learning algorithm by combining binary relevance (BR) decomposition strategy with online passive aggressive active (PAA) method. The proposed MLPAA algorithm not only uses the misclassified labels to update the classifier, but also exploits correctly classified examples with low prediction confidence. We perform extensive experimental comparison for our algorithm and the other methods using nine benchmark data sets. The encouraging results of our experiments validate the effectiveness of our proposed method.

[1]  Tom Minka,et al.  TrueSkillTM: A Bayesian Skill Rating System , 2006, NIPS.

[2]  Koby Crammer,et al.  Multi-Class Confidence Weighted Algorithms , 2009, EMNLP.

[3]  Adam Tauman Kalai,et al.  Analysis of Perceptron-Based Active Learning , 2009, COLT.

[4]  Sebastián Ventura,et al.  A Tutorial on Multilabel Learning , 2015, ACM Comput. Surv..

[5]  Steven C. H. Hoi,et al.  Online Passive Aggressive Active Learning and Its Applications , 2014, ACML.

[6]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[7]  Yoram Singer,et al.  Online multiclass learning by interclass hypothesis sharing , 2006, ICML.

[8]  Claudio Gentile,et al.  Worst-Case Analysis of Selective Sampling for Linear Classification , 2006, J. Mach. Learn. Res..

[9]  Koby Crammer,et al.  Exact Convex Confidence-Weighted Learning , 2008, NIPS.

[10]  Sunho Park,et al.  Online multi-label learning with accelerated nonsmooth stochastic gradient descent , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[11]  Xinhua Zhang,et al.  Bayesian Online Learning for Multi-label and Multi-variate Performance Measures , 2010, AISTATS.

[12]  Koby Crammer,et al.  Adaptive regularization of weight vectors , 2009, Machine Learning.

[13]  Seiichi Ozawa,et al.  A Neural Network Model for Online Multi-Task Multi-Label Pattern Recognition , 2013, ICANN.

[14]  Steven C. H. Hoi,et al.  LIBOL: a library for online learning algorithms , 2014, J. Mach. Learn. Res..

[15]  Qinghua Zheng,et al.  An efficient online active learning algorithm for binary classification , 2015, Pattern Recognit. Lett..

[16]  Craig A. Knoblock,et al.  A Survey of Digital Map Processing Techniques , 2014, ACM Comput. Surv..

[17]  Min-Ling Zhang,et al.  A Review on Multi-Label Learning Algorithms , 2014, IEEE Transactions on Knowledge and Data Engineering.

[18]  Xian-Sheng Hua,et al.  Two-Dimensional Multilabel Active Learning with an Efficient Online Adaptation Model for Image Classification , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Rong Jin,et al.  Double Updating Online Learning , 2011, J. Mach. Learn. Res..

[20]  Koby Crammer,et al.  A Family of Additive Online Algorithms for Category Ranking , 2003, J. Mach. Learn. Res..

[21]  Koby Crammer,et al.  Online Passive-Aggressive Algorithms , 2003, J. Mach. Learn. Res..