Supervised Heterogeneous Domain Adaptation via Random Forests

Heterogeneity of features and lack of correspondence between data points of different domains are the two primary challenges while performing feature transfer. In this paper, we present a novel supervised domain adaptation algorithm (SHDA-RF) that learns the mapping between heterogeneous features of different dimensions. Our algorithm uses the shared label distributions present across the domains as pivots for learning a sparse feature transformation. The shared label distributions and the relationship between the feature spaces and the label distributions are estimated in a supervised manner using random forests. We conduct extensive experiments on three diverse datasets of varying dimensions and sparsity to verify the superiority of the proposed approach over other baseline and state of the art transfer approaches.

[1]  Jialin Pan,et al.  Feature-based transfer learning with real-world applications , 2010 .

[2]  Diane J. Cook,et al.  Activity Discovery and Activity Recognition: A New Partnership , 2013, IEEE Transactions on Cybernetics.

[3]  IEEE Transactions on Knowledge and Data Engineering, Vol. 14 , 2002 .

[4]  Joydeep Ghosh,et al.  An Empirical Comparison of Hierarchical vs. Two-Level Approaches to Multiclass Problems , 2004, Multiple Classifier Systems.

[5]  Qiang Yang,et al.  Cross-domain activity recognition via transfer learning , 2011, Pervasive Mob. Comput..

[6]  Philip S. Yu,et al.  Dimensionality Reduction on Heterogeneous Feature Space , 2012, 2012 IEEE 12th International Conference on Data Mining.

[7]  Ken Lang,et al.  NewsWeeder: Learning to Filter Netnews , 1995, ICML.

[8]  John Blitzer,et al.  Domain Adaptation with Structural Correspondence Learning , 2006, EMNLP.

[9]  Axthonv G. Oettinger,et al.  IEEE Transactions on Information Theory , 1998 .

[10]  Ieee Xplore,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Information for Authors , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Ivor W. Tsang,et al.  Learning With Augmented Features for Supervised and Semi-Supervised Heterogeneous Domain Adaptation , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Michael Wooldridge,et al.  Proceedings of the 21st International Joint Conference on Artificial Intelligence , 2009 .

[14]  Diane J. Cook,et al.  Multi Home Transfer Learning for Resident Activity Discovery and Recognition , 2010 .

[15]  Ivor W. Tsang,et al.  Heterogeneous Domain Adaptation for Multiple Classes , 2014, AISTATS.

[16]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[17]  Diane J. Cook,et al.  Activity Learning: Discovering, Recognizing, and Predicting Human Behavior from Sensor Data , 2015 .

[18]  Diane J. Cook,et al.  Heterogeneous transfer learning for activity recognition using heuristic search techniques , 2014, Int. J. Pervasive Comput. Commun..

[19]  Jianhua Lin,et al.  Divergence measures based on the Shannon entropy , 1991, IEEE Trans. Inf. Theory.

[20]  Qiang Yang,et al.  Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence Transfer Learning for Activity Recognition via Sensor Mapping , 2022 .

[21]  R. Lathe Phd by thesis , 1988, Nature.

[22]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[23]  Eric Gaussier,et al.  Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing , 2006, EMNLP 2006.

[24]  Marc Langheinrich,et al.  Proceedings of the 5th international conference on Pervasive computing , 2007 .

[25]  Diane J. Cook,et al.  CASAS: A Smart Home in a Box , 2013, Computer.

[26]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[27]  Kyle D. Feuz Preparing Smart Environments for Life in the Wild: Feature-space and Multi-view Heterogeneous Transfer Learning , 2014 .

[28]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[29]  G. Englebienne,et al.  Transferring Knowledge of Activity Recognition across Sensor Networks , 2010, Pervasive.

[30]  Yan Liu,et al.  Linking Heterogeneous Input Spaces with Pivots for Multi-Task Learning , 2014, SDM.

[31]  Diane J. Cook,et al.  Transfer learning for activity recognition: a survey , 2013, Knowledge and Information Systems.