Supervised heterogeneous transfer learning using random forests

Supervised transfer learning algorithms utilize labeled data from auxiliary domains for learning in another domain where labeled data is scarce or absent. Given sufficient cross-domain corresponding instances, one can learn a robust transformation that maps the features across the domains by using any multi-output regression task. However, this cross-domain corresponding data is not available for real-world transfer tasks across heterogeneous feature spaces such as, cross-domain activity recognition and cross-lingual text/sentiment classification. In this paper, we present a shared label space driven algorithm that transfers labeled knowledge between heterogeneous feature spaces. The proposed algorithm treats the similar label distributions across the domains as pivots to generate cross-domain corresponding data. The shared label distributions and the corresponding data is obtained from the random forest models of the source and target domain. The experimental results on synthetic and real-world benchmark datasets having dissimilar modalities validate the performance of the proposed algorithm against state-of-the-art heterogeneous transfer learning approaches.

[1]  Diane J. Cook,et al.  Multi Home Transfer Learning for Resident Activity Discovery and Recognition , 2010 .

[2]  Diane J. Cook,et al.  Activity recognition on streaming sensor data , 2014, Pervasive Mob. Comput..

[3]  Diane J. Cook,et al.  Heterogeneous transfer learning for activity recognition using heuristic search techniques , 2014, Int. J. Pervasive Comput. Commun..

[4]  Narayanan Chatapuram Krishnan,et al.  Supervised Heterogeneous Domain Adaptation via Random Forests , 2016, IJCAI.

[5]  Xiaohua Hu,et al.  Linking Heterogeneous Input Features with Pivots for Domain Adaptation , 2015, IJCAI.

[6]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[7]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[8]  Joydeep Ghosh,et al.  An Empirical Comparison of Hierarchical vs. Two-Level Approaches to Multiclass Problems , 2004, Multiple Classifier Systems.

[9]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[10]  Ivor W. Tsang,et al.  Heterogeneous Domain Adaptation for Multiple Classes , 2014, AISTATS.

[11]  Rama Chellappa,et al.  Visual Domain Adaptation: A survey of recent advances , 2015, IEEE Signal Processing Magazine.

[12]  Qiang Yang,et al.  Instilling Social to Physical: Co-Regularized Heterogeneous Transfer Learning , 2016, AAAI.

[13]  Ivor W. Tsang,et al.  Hybrid Heterogeneous Transfer Learning through Deep Learning , 2014, AAAI.

[14]  Diane J. Cook,et al.  Transfer learning for activity recognition: a survey , 2013, Knowledge and Information Systems.

[15]  Hao Hu,et al.  Transfer learning for WiFi-based indoor localization , 2008, AAAI 2008.

[16]  Chang Wang,et al.  A General Framework for Manifold Alignment , 2009, AAAI Fall Symposium: Manifold Learning and Its Applications.

[17]  G. Englebienne,et al.  Transferring Knowledge of Activity Recognition across Sensor Networks , 2010, Pervasive.

[18]  Benno Stein,et al.  Cross-Language Text Classification Using Structural Correspondence Learning , 2010, ACL.

[19]  Jianhua Lin,et al.  Divergence measures based on the Shannon entropy , 1991, IEEE Trans. Inf. Theory.

[20]  Qiang Yang,et al.  Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence Transfer Learning for Activity Recognition via Sensor Mapping , 2022 .

[21]  Jinhui Tang,et al.  Weakly-Shared Deep Transfer Networks for Heterogeneous-Domain Knowledge Propagation , 2015, ACM Multimedia.

[22]  Qiang Yang,et al.  Cross-domain sentiment classification via spectral feature alignment , 2010, WWW '10.

[23]  Ken Lang,et al.  NewsWeeder: Learning to Filter Netnews , 1995, ICML.

[24]  Ivor W. Tsang,et al.  Domain Adaptation via Transfer Component Analysis , 2009, IEEE Transactions on Neural Networks.

[25]  Massih-Reza Amini,et al.  Learning from Multiple Partially Observed Views - an Application to Multilingual Text Categorization , 2009, NIPS.

[26]  Ivor W. Tsang,et al.  Learning with Augmented Features for Heterogeneous Domain Adaptation , 2012, ICML.

[27]  Philip S. Yu,et al.  Dimensionality Reduction on Heterogeneous Feature Space , 2012, 2012 IEEE 12th International Conference on Data Mining.

[28]  Yoshua Bengio,et al.  Domain Adaptation for Large-Scale Sentiment Classification: A Deep Learning Approach , 2011, ICML.

[29]  Min Xiao,et al.  Semi-supervised Subspace Co-Projection for Multi-class Heterogeneous Domain Adaptation , 2015, ECML/PKDD.

[30]  Shiliang Sun,et al.  A survey of multi-source domain adaptation , 2015, Inf. Fusion.

[31]  Chang Wang,et al.  Manifold Alignment Preserving Global Geometry , 2013, IJCAI.

[32]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[33]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[34]  Chang Wang,et al.  Heterogeneous Domain Adaptation Using Manifold Alignment , 2011, IJCAI.

[35]  John Blitzer,et al.  Domain Adaptation with Structural Correspondence Learning , 2006, EMNLP.

[36]  Qiang Yang,et al.  Heterogeneous Transfer Learning for Image Classification , 2011, AAAI.

[37]  Diane J. Cook,et al.  CASAS: A Smart Home in a Box , 2013, Computer.

[38]  Yu-Chiang Frank Wang,et al.  Learning Cross-Domain Landmarks for Heterogeneous Domain Adaptation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Concha Bielza,et al.  A survey on multi‐output regression , 2015, WIREs Data Mining Knowl. Discov..

[40]  Yuji Matsumoto,et al.  Transfer Learning for Multiple-Domain Sentiment Analysis - Identifying Domain Dependent/Independent Word Polarity , 2011, AAAI.

[41]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.