Transfer Learning by Sample Selection Bias Correction and Its Application in Communication Specific Emitter Identification

—In many traditional machine learning algorithms, a major assumption is that the training samples and the test samples have the same distribution. However, this assumption does not hold in many real applications. In recent years, transfer learning has attracted a significant amount of attention to solve this problem. In this paper, a novel transfer learning method based on clustering analysis and re-sampling is proposed, which can correct different types of domain differences and does not need to estimate the different distribution directly. The method explores the data structure by clustering analysis, and then uses the obtained structure information to generate a new training set for target learning under a re-sampling strategy. To explore more data structure information and be more robust to data sets with various shapes and densities, the method introduces the fuzzy neighborhood membership degree to improve the performance of clustering analysis. It also applies the Gaussian kernel function to measure the similarities between samples to improve the reliability of the new training samples. The proposed method can transfer more useful knowledge from the source domain to the target domain. Experimental results on toy datasets demonstrate that the proposed method can effectively and stably enhance the learning performance. Finally, the proposed algorithm is applied to the communication specific emitter identification task and the result is also satisfying.

[1]  Julio Gonzalo,et al.  An unsupervised transfer learning approach to discover topics for online reputation management , 2013, CIKM.

[2]  Zhang Jianpei,et al.  FSFP: Transfer Learning From Long Texts to the Short , 2014 .

[3]  Philip S. Yu,et al.  Type-Independent Correction of Sample Selection Bias via Structural Discovery and Re-balancing , 2008, SDM.

[4]  Bianca Zadrozny,et al.  Learning and evaluating classifiers under sample selection bias , 2004, ICML.

[5]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[6]  Shiliang Sun,et al.  A survey of multi-source domain adaptation , 2015, Inf. Fusion.

[7]  Jie Yang,et al.  Learning to Transfer PrivilegedRanking Attribute for Object Classification , 2015 .

[8]  Zhaohong Deng,et al.  Generalized Hidden-Mapping Ridge Regression, Knowledge-Leveraged Inductive Transfer Learning for Neural Networks, Fuzzy Systems and Kernel Methods , 2014, IEEE Transactions on Cybernetics.

[9]  W. Gao,et al.  Information-Theoretic Multi-view Domain Adaptation: A Theoretical and Empirical Study , 2014, J. Artif. Intell. Res..

[10]  Luis Alfonso Maeda-Nunez,et al.  Learning Transfer-Based Adaptive Energy Minimization in Embedded Systems , 2016, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[11]  Daoqiang Zhang,et al.  Multimodal manifold-regularized transfer learning for MCI conversion prediction , 2015, Brain Imaging and Behavior.

[12]  Ling Shao,et al.  Transfer Learning for Visual Categorization: A Survey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Bo Du,et al.  Unsupervised transfer learning for target detection from hyperspectral images , 2013, Neurocomputing.

[14]  Pascal Vincent,et al.  Unsupervised and Transfer Learning under Uncertainty - From Object Detections to Scene Categorization , 2013, ICPRAM.

[15]  Bernhard Schölkopf,et al.  Correcting Sample Selection Bias by Unlabeled Data , 2006, NIPS.

[16]  Motoaki Kawanabe,et al.  Direct Importance Estimation with Model Selection and Its Application to Covariate Shift Adaptation , 2007, NIPS.

[17]  Ian Davidson,et al.  On Sample Selection Bias and Its Efficient Correction via Model Averaging and Unlabeled Examples , 2007, SDM.

[18]  Chengqi Zhang,et al.  TrGraph: Cross-Network Transfer Learning via Common Signature Subgraphs , 2015, IEEE Trans. Knowl. Data Eng..

[19]  Qiang Yang,et al.  Indoor localization in multi-floor environments with reduced effort , 2010, 2010 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[20]  Yan Liu,et al.  A general framework for scalable transductive transfer learning , 2013, Knowledge and Information Systems.

[21]  Efendi N. Nasibov,et al.  Fuzzy and crisp clustering methods based on the neighborhood concept: A comprehensive review , 2012, J. Intell. Fuzzy Syst..

[22]  Peng Hao,et al.  Transfer learning using computational intelligence: A survey , 2015, Knowl. Based Syst..