A Novel Angular-Based Unsupervised Domain Adaptation Framework for Image Classification

Domain adaptation (DA) deals with the common problem of distribution mismatch between the training and the target data. A model tested on data that comes from a different source than the training data will not perform well. DA methods aim to utilize the available training and testing data to model a target domain classifier. Domain invariant features are extracted and used to minimize the distribution divergence between the source and target domains. At the same time, there exist some imperative limitations. The angle between the subspaces of the source and target domains is not reduced during distribution alignment, and the formulation of an objective function, that reduces geometric and statistical deviations, must be used. None of the DA strategies in use today address these constraints simultaneously. Therefore, we propose a novel DA framework, called angular-based unsupervised domain adaptation framework for image classification (AUDAF) to address these limitations. AUDAF first obtains the pseudo labels for the unlabeled target domain data using a simple k-Nearest Neighbor classifier (trained on source domain data) and then formulates a robust objective function to reduce domain discrepancy. The objective function can be solved efficiently in a closed form by considering a couple of projection vector matrices (one for source, the other for target). Extensive testing on benchmark DA datasets shows that AUDAF performs better than existing DA methods in terms of classification accuracy.

[1]  Weihua Ou,et al.  Unsupervised domain adaptation based on adaptive local manifold learning , 2022, Comput. Electr. Eng..

[2]  J. Dezert,et al.  Cross-Domain Pattern Classification With Distribution Adaptation Based on Evidence Theory , 2021, IEEE Transactions on Cybernetics.

[3]  G. Qin,et al.  Dual guidance enhanced network for light field salient object detection , 2021, Image Vis. Comput..

[4]  Xinjie Fan,et al.  A Prototype-Oriented Framework for Unsupervised Domain Adaptation , 2021, NeurIPS.

[5]  Niranjan N. Chiplunkar,et al.  Image Classification and Prediction using Transfer Learning in Colab Notebook , 2021, Global Transitions Proceedings.

[6]  J. Straub Machine learning performance validation and training using a ‘perfect’ expert system , 2021, MethodsX.

[7]  Xiangzhong Fang,et al.  PDA: Proxy-based domain adaptation for few-shot image recognition , 2021, Image Vis. Comput..

[8]  Rakesh Kumar Sanodiya,et al.  Discriminative information preservation: A general framework for unsupervised visual Domain Adaptation , 2021, Knowl. Based Syst..

[9]  Wen'an Zhou,et al.  Cluster adaptation networks for unsupervised domain adaptation , 2021, Image Vis. Comput..

[10]  Judy Hoffman,et al.  SENTRY: Selective Entropy Optimization via Committee Consistency for Unsupervised Domain Adaptation , 2020, 2021 IEEE/CVF International Conference on Computer Vision (ICCV).

[11]  Liran Yang,et al.  Discriminative and informative joint distribution adaptation for unsupervised domain adaptation , 2020, Knowl. Based Syst..

[12]  Haibo He,et al.  Discriminant Geometrical and Statistical Alignment With Density Peaks for Domain Adaptation , 2020, IEEE Transactions on Cybernetics.

[13]  Franck Davoine,et al.  Transfer learning in computer vision tasks: Remember where you come from , 2020, Image Vis. Comput..

[14]  Jimson Mathew,et al.  A Kernelized Unified Framework for Domain Adaptation , 2019, IEEE Access.

[15]  Jimson Mathew,et al.  A novel unsupervised Globality-Locality Preserving Projections in transfer learning , 2019, Image Vis. Comput..

[16]  Zhu Lei,et al.  Locality Preserving Joint Transfer for Domain Adaptation , 2019, IEEE Transactions on Image Processing.

[17]  Zhenan Sun,et al.  Aggregating Randomized Clustering-Promoting Invariant Projections for Domain Adaptation , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Trevor Darrell,et al.  Semi-Supervised Domain Adaptation via Minimax Entropy , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[19]  Yue Zhang,et al.  Structural Domain Adaptation with Latent Graph Alignment , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[20]  Chao Chen,et al.  Joint Domain Alignment and Discriminative Feature Learning for Unsupervised Deep Domain Adaptation , 2018, AAAI.

[21]  Cheng Wu,et al.  Domain Invariant and Class Discriminative Feature Learning for Visual Domain Adaptation , 2018, IEEE Transactions on Image Processing.

[22]  Yiqiang Chen,et al.  Balanced Distribution Adaptation for Transfer Learning , 2017, 2017 IEEE International Conference on Data Mining (ICDM).

[23]  Liming Chen,et al.  Robust Data Geometric Structure Aligned Close yet Discriminative Domain Adaptation , 2017, ArXiv.

[24]  Jing Zhang,et al.  Joint Geometrical and Statistical Alignment for Visual Domain Adaptation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Jing Zhang,et al.  Transfer Learning for Cross-Dataset Recognition: A Survey , 2017, 1705.04396.

[26]  Yun Fu,et al.  Robust Transfer Metric Learning for Image Classification , 2017, IEEE Transactions on Image Processing.

[27]  Kate Saenko,et al.  Correlation Alignment for Unsupervised Domain Adaptation , 2016, Domain Adaptation in Computer Vision Applications.

[28]  Mehrtash Tafazzoli Harandi,et al.  Learning an Invariant Hilbert Space for Domain Adaptation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Michael I. Jordan,et al.  Deep Transfer Learning with Joint Adaptation Networks , 2016, ICML.

[30]  Mengjie Zhang,et al.  Scatter Component Analysis: A Unified Framework for Domain Adaptation and Domain Generalization , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Michael I. Jordan,et al.  Learning Transferable Features with Deep Adaptation Networks , 2015, ICML.

[32]  Trevor Darrell,et al.  Deep Domain Confusion: Maximizing for Domain Invariance , 2014, CVPR 2014.

[33]  Philip S. Yu,et al.  Transfer Joint Matching for Unsupervised Domain Adaptation , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  Alexey L. Pomerantsev,et al.  Principal Component Analysis (PCA) , 2014, Encyclopedia of Autism Spectrum Disorders.

[35]  Philip S. Yu,et al.  Adaptation Regularization: A General Framework for Transfer Learning , 2014, IEEE Transactions on Knowledge and Data Engineering.

[36]  Li Cheng,et al.  Semi-supervised Domain Adaptation on Manifolds , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[37]  Ming Shao,et al.  Generalized Transfer Subspace Learning Through Low-Rank Constraint , 2014, International Journal of Computer Vision.

[38]  Philip S. Yu,et al.  Transfer Feature Learning with Joint Distribution Adaptation , 2013, 2013 IEEE International Conference on Computer Vision.

[39]  Tinne Tuytelaars,et al.  Unsupervised Visual Domain Adaptation Using Subspace Alignment , 2013, 2013 IEEE International Conference on Computer Vision.

[40]  Trevor Darrell,et al.  Semi-supervised Domain Adaptation with Instance Constraints , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Zhaohong Deng,et al.  Knowledge-Leverage-Based TSK Fuzzy System Modeling , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[42]  Dit-Yan Yeung,et al.  Transfer metric learning by learning task relationships , 2010, KDD.

[43]  Ivor W. Tsang,et al.  Domain Adaptation via Transfer Component Analysis , 2009, IEEE Transactions on Neural Networks.

[44]  Andreas Christmann,et al.  Support vector machines , 2008, Data Mining and Knowledge Discovery Handbook.

[45]  Yu Zhang,et al.  Selective Partial Domain Adaptation , 2022, BMVC.

[46]  Yuwu Lu,et al.  Manifold Transfer Learning via Discriminant Regression Analysis , 2021, IEEE Transactions on Multimedia.

[47]  Rakesh Kumar Sanodiya,et al.  Linear Discriminant Analysis via Pseudo Labels: A Unified Framework for Visual Domain Adaptation , 2020, IEEE Access.

[48]  Kate Saenko,et al.  Subspace Distribution Alignment for Unsupervised Domain Adaptation , 2015, BMVC.

[49]  A. Banerji Science and Engineering , 1910, Nature.