Evidential combination of augmented multi-source of information based on domain adaptation

In the applications of domain adaptation (DA), there may exist multiple source domains, and each source domain usually provides some auxiliary information for object classification. The combination of such complementary knowledge from different source domains is helpful for improving the accuracy. We propose an evidential combination of augmented multi-source of information (ECAMI) method. The information sources are augmented at first by merging several randomly selected source domains to generate extra auxiliary information. We can obtain one piece of classification result with the assistance of each information source based on DA. Then these multiple classification results are combined by belief functions theory, which is expert at dealing with the uncertain information. Nevertheless, the classification results derived from different information sources may have different weights. The optimal weights are calculated by minimizing an given error criteria defined by the distance between the combination result and the ground truth using some training data. For each object, the augmented information sources will produce multiple classification results that will be discounted by the learnt weights under the belief functions framework. Then the combination of these discounted results is employed to make the final class decision. The effectiveness of ECAMI is evaluated with respect to some related methods based on several real data sets, and the experimental results show that ECAMI can significantly improve the classification accuracy.

[1]  Rajat Raina,et al.  Self-taught learning: transfer learning from unlabeled data , 2007, ICML '07.

[2]  José M. F. Moura,et al.  Multiple Source Domain Adaptation with Adversarial Learning , 2018, ICLR.

[3]  Tinne Tuytelaars,et al.  Unsupervised Visual Domain Adaptation Using Subspace Alignment , 2013, 2013 IEEE International Conference on Computer Vision.

[4]  Liang Gao,et al.  A New Deep Transfer Learning Based on Sparse Auto-Encoder for Fault Diagnosis , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[5]  Shiliang Sun,et al.  A survey of multi-source domain adaptation , 2015, Inf. Fusion.

[6]  Qiang Yang,et al.  Boosting for transfer learning , 2007, ICML '07.

[7]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[8]  Liang Lin,et al.  Deep Cocktail Network: Multi-source Unsupervised Domain Adaptation with Category Shift , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[9]  Ivor W. Tsang,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 1 Domain Adaptation from Multiple Sources: A Domain- , 2022 .

[10]  Wei He,et al.  Fault-alarm-threshold optimization method based on interval evidence reasoning , 2018, Science China Information Sciences.

[11]  Thierry Denoeux,et al.  Combination of Transferable Classification With Multisource Domain Adaptation Based on Evidential Reasoning , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[12]  Yiqiang Chen,et al.  Balanced Distribution Adaptation for Transfer Learning , 2017, 2017 IEEE International Conference on Data Mining (ICDM).

[13]  Deqing Wang,et al.  Aligning Domain-Specific Distribution and Classifier for Cross-Domain Classification from Multiple Sources , 2019, AAAI.

[14]  Thierry Denoeux,et al.  Logistic Regression, Neural Networks and Dempster-Shafer Theory: a New Perspective , 2018, Knowl. Based Syst..

[15]  Shih-Ping Han A globally convergent method for nonlinear programming , 1975 .

[16]  Josephine Sullivan,et al.  Apprenticeship Learning: Transfer of Knowledge via Dataset Augmentation , 2013, SCIA.

[17]  Philip S. Yu,et al.  Transfer Feature Learning with Joint Distribution Adaptation , 2013, 2013 IEEE International Conference on Computer Vision.

[18]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[19]  Umar Aftab,et al.  Big Data Augmentation with Data Warehouse: A Survey , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[20]  Cheng Wu,et al.  Domain Space Transfer Extreme Learning Machine for Domain Adaptation , 2019, IEEE Transactions on Cybernetics.

[21]  Amaury Lendasse,et al.  Domain Adaption via Feature Selection on Explicit Feature Map , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Quan Pan,et al.  Combination of Classifiers With Optimal Weight Based on Evidential Reasoning , 2018, IEEE Transactions on Fuzzy Systems.

[23]  Jean Dezert,et al.  Credal c-means clustering method based on belief functions , 2015, Knowl. Based Syst..

[24]  Philip S. Yu,et al.  Transfer Joint Matching for Unsupervised Domain Adaptation , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Hans-Peter Kriegel,et al.  Integrating structured biological data by Kernel Maximum Mean Discrepancy , 2006, ISMB.

[26]  Yue Cao,et al.  Transferable Representation Learning with Deep Adaptation Networks , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Jean Dezert,et al.  On the Validity of Dempster's Fusion Rule and its Interpretation as a Generalization of Bayesian Fusion Rule , 2014, Int. J. Intell. Syst..

[28]  Koby Crammer,et al.  Analysis of Representations for Domain Adaptation , 2006, NIPS.

[29]  Ling Shao,et al.  Transfer Learning for Visual Categorization: A Survey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[30]  Cheng Wu,et al.  Cross-Domain Extreme Learning Machines for Domain Adaptation , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[31]  Ming Shao,et al.  Incomplete Multisource Transfer Learning , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[32]  Yuan Shi,et al.  Geodesic flow kernel for unsupervised domain adaptation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[33]  Witold Pedrycz,et al.  Aggregating multiple classification results using fuzzy integration and stochastic feature selection , 2010, Int. J. Approx. Reason..

[34]  Thierry Denoeux,et al.  A k-nearest neighbor classification rule based on Dempster-Shafer theory , 1995, IEEE Trans. Syst. Man Cybern..

[35]  Thierry Denoeux,et al.  Decision-Making with Belief Functions: a Review , 2018, Int. J. Approx. Reason..

[36]  Hui Xiong,et al.  A Unified Framework for Metric Transfer Learning , 2017, IEEE Transactions on Knowledge and Data Engineering.

[37]  Ivor W. Tsang,et al.  Domain Adaptation via Transfer Component Analysis , 2009, IEEE Transactions on Neural Networks.

[38]  Ming Shao,et al.  Structure-Preserved Multi-source Domain Adaptation , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[39]  Chang-Hua Hu,et al.  Fault prediction model based on evidential reasoning approach , 2010, Science China Information Sciences.

[40]  Trevor Darrell,et al.  Adversarial Discriminative Domain Adaptation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Kate Saenko,et al.  Return of Frustratingly Easy Domain Adaptation , 2015, AAAI.