Sparse Transfer Classification for Text Documents

Transfer learning supports classification in domains varying from the learning domain. Prominent applications can be found in Wifi-localization, sentiment classification or robotics. A recent study shows that approximation of training trough test environments is leading to proper performance and out-dates the strategy most transfer learning approaches pursue. Additionally, sparse transfer learning models are required to address technical limitations and the demand for interpretability due to recent privacy regulations. In this work, we propose a new transfer learning approach which approximates the learning environment, combine it with the sparse and interpretable probabilistic classification vector machine and compare our solution with standard benchmarks in the field.

[1]  Susan T. Dumais,et al.  Latent semantic analysis , 2005, Scholarpedia.

[2]  Philip S. Yu,et al.  Transfer Feature Learning with Joint Distribution Adaptation , 2013, 2013 IEEE International Conference on Computer Vision.

[3]  Taghi M. Khoshgoftaar,et al.  A survey of transfer learning , 2016, Journal of Big Data.

[4]  Philip S. Yu,et al.  Domain Invariant Transfer Kernel Learning , 2015, IEEE Transactions on Knowledge and Data Engineering.

[5]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[6]  Jianmin Wang,et al.  Transfer Learning with Graph Co-Regularization , 2012, IEEE Transactions on Knowledge and Data Engineering.

[7]  Yuan Shi,et al.  Geodesic flow kernel for unsupervised domain adaptation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Qiang Yang,et al.  Co-clustering based classification for out-of-domain documents , 2007, KDD '07.

[9]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[10]  Frank-Michael Schleif,et al.  Metric and non-metric proximity transformations at linear costs , 2014, Neurocomputing.

[11]  Ivor W. Tsang,et al.  Domain Adaptation via Transfer Component Analysis , 2009, IEEE Transactions on Neural Networks.

[12]  Huanhuan Chen,et al.  Probabilistic Classification Vector Machines , 2009, IEEE Transactions on Neural Networks.

[13]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[14]  Peter Tiño,et al.  Incremental probabilistic classification vector machine with linear costs , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[15]  Qiang Yang,et al.  Boosting for transfer learning , 2007, ICML '07.