Canonical Correlation Discriminative Learning for Domain Adaptation

Domain adaptation aims to diminish the discrepancy between the source and target domains and enhance the classification ability for the target samples by using well-labeled source domain data. However, most existing methods concentrate on learning domain invariant features for cross-domain tasks, but ignore the correlation and discriminative information between different domains. If the learned features from the source and target domains are not correlated, the adaptability of domain adaptation methods will be greatly degraded. To make up for this deficiency, we propose a novel domain adaptation approach, referred to as Canonical Correlation Discriminative Learning (CCDL) for domain adaptation. By introducing a novel correlation representation, CCDL maximizes the correlations of the learned features from the two domains as much as possible. Specifically, CCDL learns a latent feature representation to reduce the difference by jointly adapting the marginal and conditional distributions between the source and target domains, and simultaneously maximizes the inter-class distance and minimizes the intra-class scatter. The experiments certify that CCDL is superior to several state-of-the-art methods on four visual benchmark databases.

[1]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[2]  Jing Zhang,et al.  Joint Geometrical and Statistical Alignment for Visual Domain Adaptation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Michael K. Ng,et al.  Sparse Canonical Correlation Analysis: New Formulation and Algorithm , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  David Zhang,et al.  Learning Domain-Invariant Subspace Using Domain Features and Independence Maximization , 2016, IEEE Transactions on Cybernetics.

[5]  Philip S. Yu,et al.  Visual Domain Adaptation with Manifold Embedded Distribution Alignment , 2018, ACM Multimedia.

[6]  Gao Huang,et al.  Prediction Reweighting for Domain Adaptation , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Jindong Wang,et al.  Easy Transfer Learning By Exploiting Intra-Domain Structures , 2019, 2019 IEEE International Conference on Multimedia and Expo (ICME).

[8]  Jian Yang,et al.  Instance Selection and Instance Weighting for Cross-Domain Sentiment Classification via PU Learning , 2013, IJCAI.

[9]  Bernhard Schölkopf,et al.  Correcting Sample Selection Bias by Unlabeled Data , 2006, NIPS.

[10]  Jiwen Lu,et al.  Deep transfer metric learning , 2015, CVPR.

[11]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[12]  Philip S. Yu,et al.  Transfer Feature Learning with Joint Distribution Adaptation , 2013, 2013 IEEE International Conference on Computer Vision.

[13]  Ivor W. Tsang,et al.  Domain Adaptation via Transfer Component Analysis , 2009, IEEE Transactions on Neural Networks.

[14]  Philip S. Yu,et al.  Transfer Joint Matching for Unsupervised Domain Adaptation , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Yuan Shi,et al.  Geodesic flow kernel for unsupervised domain adaptation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Amaury Lendasse,et al.  Domain Adaption via Feature Selection on Explicit Feature Map , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Cheng Wu,et al.  Domain Invariant and Class Discriminative Feature Learning for Visual Domain Adaptation , 2018, IEEE Transactions on Image Processing.

[18]  Ke Lu,et al.  Locality Preserving Joint Transfer for Domain Adaptation , 2019, IEEE Transactions on Image Processing.

[19]  Yiqiang Chen,et al.  Balanced Distribution Adaptation for Transfer Learning , 2017, 2017 IEEE International Conference on Data Mining (ICDM).

[20]  Lei Zhang,et al.  Unsupervised Domain Adaptation Using Robust Class-Wise Matching , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  H. Hotelling Relations Between Two Sets of Variates , 1936 .

[22]  Paul Geladi,et al.  Principal Component Analysis , 1987, Comprehensive Chemometrics.