Semi-supervised transfer discriminant analysis based on cross-domain mean constraint

In this paper, a novel semi-supervised feature extraction algorithm, i.e., semi-supervised transfer discriminant analysis (STDA) with knowledge transfer capability is proposed, based on the traditional algorithm that cannot get adapted in the change of the learning environment. By using both the pseudo label information from target domain samples and the actual label information from source domain samples in the label iterative refinement process, not only the between-class scatter is maximized while that within-class scatter is minimized, but also the original space structure is maintained via Laplacian matrix, and the distribution difference is reduced by using maximum mean discrepancy as well. Moreover, semi-supervised transfer discriminant analysis based on cross-domain mean constraint (STDA-CMC) is proposed. In this algorithm, the cross-domain mean constraint term is incorporated into STDA, such that knowledge transfer between domains is facilitated by making source and target samples after being projected are located more closely in the low-dimensional feature subspace. The proposed algorithm is proved efficient and feasible from experiments on several datasets.

[1]  Erkki Oja,et al.  Adaptive Multiplicative Updates for Projective Nonnegative Matrix Factorization , 2012, ICONIP.

[2]  Yuan Shi,et al.  Geodesic flow kernel for unsupervised domain adaptation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Donghua Zhou,et al.  Discriminative Dictionary Learning with Low-Rank Error Model for Robust Crater Recognition , 2015, IEICE Trans. Inf. Syst..

[4]  TaoDacheng,et al.  Bregman Divergence-Based Regularization for Transfer Subspace Learning , 2010 .

[5]  Jiawei Han,et al.  Semi-supervised Discriminant Analysis , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[6]  Sidan Du,et al.  Semi-Supervised Nonparametric Discriminant Analysis , 2013, IEICE Trans. Inf. Syst..

[7]  Philip S. Yu,et al.  Transfer Feature Learning with Joint Distribution Adaptation , 2013, 2013 IEEE International Conference on Computer Vision.

[8]  Norimichi Tsumura,et al.  Principal component analysis for dental shade color. , 2012, Dental materials : official publication of the Academy of Dental Materials.

[9]  Wei Zhou,et al.  L1-Norm Based Linear Discriminant Analysis: An Application to Face Recognition , 2013, IEICE Trans. Inf. Syst..

[10]  Shuicheng Yan,et al.  Neighborhood preserving embedding , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[11]  Pramod Kumar Singh,et al.  A Two-Stage Unsupervised Dimension Reduction Method for Text Clustering , 2012, BIC-TA.

[12]  Zhong Jin,et al.  Feature extraction using two-dimensional local graph embedding based on maximum margin criterion , 2011, Appl. Math. Comput..

[13]  Hans-Peter Kriegel,et al.  Integrating structured biological data by Kernel Maximum Mean Discrepancy , 2006, ISMB.

[14]  Yang Liu,et al.  Locally linear embedding: a survey , 2011, Artificial Intelligence Review.

[15]  Ivor W. Tsang,et al.  Domain Adaptation via Transfer Component Analysis , 2009, IEEE Transactions on Neural Networks.

[16]  Dan Wu,et al.  Adaptive Laplacian Eigenmap-Based Dimension Reduction for Ocean Target Discrimination , 2016, IEEE Geoscience and Remote Sensing Letters.

[17]  Jiawei Han,et al.  Speed up kernel discriminant analysis , 2011, The VLDB Journal.

[18]  Dongbin Zhao,et al.  A Semi-Supervised Predictive Sparse Decomposition Based on Task-Driven Dictionary Learning , 2017, Cognitive Computation.

[19]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[20]  Einoshin Suzuki,et al.  Linear Semi-Supervised Dimensionality Reduction with Pairwise Constraint for Multiple Subclasses , 2012, IEICE Trans. Inf. Syst..

[21]  Piotr Indyk,et al.  Approximate Nearest Neighbor: Towards Removing the Curse of Dimensionality , 2012, Theory Comput..

[22]  Longin Jan Latecki,et al.  Transductive Domain Adaptation with Affinity Learning , 2015, CIKM.

[23]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.