An Online Transfer Learning Algorithm with Adaptive Cost

Online transfer learning aims to attack an online learning task on a target domain by transferring knowledge from some source domains, which has received more attentions. And most online transfer learning methods adapt the classifier according to its accuracy on new coming data. However, in real-world applications, such as anomaly detection and credit card fraud detection, the cost may be more important than the accuracy. Moreover, the cost usually changes in these online data, which challenges state-of-art-methods. Therefore, this paper introduces the cost of misclassification into transfer-learning of classifier, and proposes a novel online transfer learning algorithm with adaptive cost (OLAC). Firstly, we introduce the label distribution into traditional Hinge Loss Function to compute the cost of classification adaptively. Secondly, we transfer learn the classifier according to its performance on new coming data including both accuracy and cost. Extensive experimental results show that our method can achieve higher accuracy and less classification lost, especially for the samples with higher costs.

[1]  Min Wu,et al.  Cost-Sensitive Online Classification with Adaptive Regularization and Its Applications , 2015, 2015 IEEE International Conference on Data Mining.

[2]  Nuno Vasconcelos,et al.  Cost-Sensitive Boosting , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Baowen Xu,et al.  Cost-sensitive transfer kernel canonical correlation analysis for heterogeneous defect prediction , 2018, Automated Software Engineering.

[4]  Qingyao Wu,et al.  Online Transfer Learning with Multiple Homogeneous or Heterogeneous Sources , 2017, IEEE Transactions on Knowledge and Data Engineering.

[5]  Steven C. H. Hoi,et al.  Cost Sensitive Online Multiple Kernel Classification , 2016, ACML.

[6]  Steven C. H. Hoi,et al.  OTL: A Framework of Online Transfer Learning , 2010, ICML.

[7]  Yang Wang,et al.  Cost-sensitive boosting for classification of imbalanced data , 2007, Pattern Recognit..

[8]  Liang Ge,et al.  OMS-TL: a framework of online multiple source transfer learning , 2013, CIKM.

[9]  Yishay Mansour,et al.  Domain Adaptation with Multiple Sources , 2008, NIPS.

[10]  Bin Li,et al.  Online Transfer Learning , 2014, Artif. Intell..

[11]  Jongmoon Baik,et al.  A transfer cost-sensitive boosting approach for cross-project defect prediction , 2017, Software Quality Journal.

[12]  Yaobin Mao,et al.  A review of boosting methods for imbalanced data classification , 2014, Pattern Analysis and Applications.

[13]  Jaime G. Carbonell,et al.  Cost-Sensitive Risk Stratification in the Diagnosis of Heart Disease , 2012, IAAI.

[14]  Qiang Yang,et al.  Multi-transfer: Transfer learning with multiple views and multiple sources , 2014 .

[15]  Thomas G. Dietterich,et al.  A Wrapper Method for Cost-Sensitive Learning via Stratification , 2007 .

[16]  Jose Garcia,et al.  Online classifier adaptation for cost-sensitive learning , 2015, Neural Computing and Applications.

[17]  Gunwoo Kim,et al.  Classification cost: An empirical comparison among traditional classifier, Cost-Sensitive Classifier, and MetaCost , 2012, Expert Syst. Appl..

[18]  Koby Crammer,et al.  Online Passive-Aggressive Algorithms , 2003, J. Mach. Learn. Res..

[19]  Steven C. H. Hoi,et al.  Cost-Sensitive Online Classification , 2012, 2012 IEEE 12th International Conference on Data Mining.