Transfer Learning by Fuzzy Neighborhood Density-Based Clustering and Re-sampling

In many machine learning algorithms, a major assumption is that the training samples and the test samples have the same distribution. However, this assumption does not hold in many real applications. In recent years, transfer learning has attracted a significant amount of attention to solve this problem. Among these methods, an effective algorithm based on clustering analysis and re-sampling can correct different types of domain differences and does not need to estimate the different distribution directly. As the critical part, its original clustering method is not good enough at data structure exploration due to poor robustness on the data with various shapes and densities. In this paper, a new transfer learning algorithm based on fuzzy neighborhood density-based clustering and re-sampling is proposed, which is more robust to datasets with various shapes and densities, and could explore more data structure information. With the better explored data structure information, the proposed method can transfer more useful knowledge from source domain to target domain. Validation of the proposed method is performed with extensive experiments.

[1]  Qiang Yang,et al.  Indoor localization in multi-floor environments with reduced effort , 2010, 2010 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[2]  Peng Hao,et al.  Transfer learning using computational intelligence: A survey , 2015, Knowl. Based Syst..

[3]  Philip S. Yu,et al.  Type-Independent Correction of Sample Selection Bias via Structural Discovery and Re-balancing , 2008, SDM.

[4]  Luis Alfonso Maeda-Nunez,et al.  Learning Transfer-Based Adaptive Energy Minimization in Embedded Systems , 2016, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[5]  Daoqiang Zhang,et al.  Multimodal manifold-regularized transfer learning for MCI conversion prediction , 2015, Brain Imaging and Behavior.

[6]  Ian Davidson,et al.  On Sample Selection Bias and Its Efficient Correction via Model Averaging and Unlabeled Examples , 2007, SDM.

[7]  Yan Liu,et al.  A general framework for scalable transductive transfer learning , 2013, Knowledge and Information Systems.

[8]  Motoaki Kawanabe,et al.  Direct Importance Estimation with Model Selection and Its Application to Covariate Shift Adaptation , 2007, NIPS.

[9]  Efendi N. Nasibov,et al.  Fuzzy and crisp clustering methods based on the neighborhood concept: A comprehensive review , 2012, J. Intell. Fuzzy Syst..

[10]  Bernhard Schölkopf,et al.  Correcting Sample Selection Bias by Unlabeled Data , 2006, NIPS.

[11]  Chengqi Zhang,et al.  TrGraph: Cross-Network Transfer Learning via Common Signature Subgraphs , 2015, IEEE Transactions on Knowledge and Data Engineering.

[12]  Bianca Zadrozny,et al.  Learning and evaluating classifiers under sample selection bias , 2004, ICML.