Instance Transfer Learning with Multisource Dynamic TrAdaBoost

Since the transfer learning can employ knowledge in relative domains to help the learning tasks in current target domain, compared with the traditional learning it shows the advantages of reducing the learning cost and improving the learning efficiency. Focused on the situation that sample data from the transfer source domain and the target domain have similar distribution, an instance transfer learning method based on multisource dynamic TrAdaBoost is proposed in this paper. In this method, knowledge from multiple source domains is used well to avoid negative transfer; furthermore, the information that is conducive to target task learning is obtained to train candidate classifiers. The theoretical analysis suggests that the proposed algorithm improves the capability that weight entropy drifts from source to target instances by means of adding the dynamic factor, and the classification effectiveness is better than single source transfer. Finally, experimental results show that the proposed algorithm has higher classification accuracy.

[1]  Peter Stone,et al.  Boosting for Regression Transfer , 2010, ICML.

[2]  W. Marsden.  I and J , 2012 .

[3]  Zhang Qia.  Instance-based Transfer Learning for Multi-source Domains , 2014 .

[4]  Yi Yao,et al.  Boosting for transfer learning with multiple sources , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Eric Eaton,et al.  Set-Based Boosting for Instance-Level Transfer , 2009, 2009 IEEE International Conference on Data Mining Workshops.

[6]  Daniel Marcu,et al.  Domain Adaptation for Statistical Classifiers , 2006, J. Artif. Intell. Res..

[7]  Lawrence Carin,et al.  Logistic regression with an auxiliary data source , 2005, ICML.

[8]  Shai Ben-David,et al.  Exploiting Task Relatedness for Mulitple Task Learning , 2003, COLT.

[9]  Chandan K. Reddy,et al.  Adaptive Boosting for Transfer Learning Using Dynamic Updates , 2011, ECML/PKDD.

[10]  Chen Xing-guo,et al.  Transfer of Reinforcement Learning:The State of the Art , 2008 .

[11]  Eric Eaton,et al.  Selective knowledge transfer for machine learning , 2009 .

[12]  Peter Stone,et al.  Transfer Learning for Reinforcement Learning Domains: A Survey , 2009, J. Mach. Learn. Res..

[13]  Thomas G. Dietterich,et al.  To transfer or not to transfer , 2005, NIPS 2005.

[14]  Thomas G. Dietterich,et al.  Improving SVM accuracy by training on auxiliary data sources , 2004, ICML.

[15]  Wang Xuesong,et al.  Weighted Multi-source TrAdaBoost ∗ , 2013 .

[16]  Qiang Yang,et al.  Boosting for transfer learning , 2007, ICML '07.