A Novel Transfer Metric Learning Approach Based on Multi-Group

In recent years, transfer learning receives increasingly attention ranging from the communities of developmental robots, computer vision to artificial intelligence. In the research of transfer learning, knowledge should be transferred from the source domain to the target domain. The source domain is used to train a classifier while the target domain is for testing. Existing works consider the source domain as a whole, however, samples in the source domain might be extracted into different groups and the samples in the same group would have similar intrinsic attributes. In this work, we propose a novel transfer metric learning framework based on multi-group, called TMLMG. In TMLMG, based on each group both a Mahalanobis distance metric and a basic classifier are learned to make predictions. A weight matrix is used to describe the prediction capabilites of all the combinations of groups and Mahalanobis distance metrics. The weight matrix is initialized and optimized based on the labeled samples in the target domain. Experimental results on publicly available datasets of object recognition and handwriting recognition verify the effectiveness of our proposed TMLMG in knowledge transfer.

[1]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[2]  Jiwen Lu,et al.  Deep transfer metric learning , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Rama Chellappa,et al.  Hierarchical Multimodal Metric Learning for Multimodal Classification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Mark H. Lee,et al.  The infant development timeline and its application to robot shaping , 2011, Adapt. Behav..

[5]  Steve Branson,et al.  Similarity metrics for categorization: From monolithic to category specific , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[6]  Ivor W. Tsang,et al.  Minimax Sparse Logistic Regression for Very High-Dimensional Feature Selection , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Zhi-Hua Zhou,et al.  What Makes Objects Similar: A Unified Multi-Metric Learning Approach , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Yukie Nagai,et al.  Staged Development of Robot Skills: Behavior Formation, Affordance Learning and Imitation with Motionese , 2015, IEEE Transactions on Autonomous Mental Development.

[9]  Motoaki Kawanabe,et al.  Direct Importance Estimation with Model Selection and Its Application to Covariate Shift Adaptation , 2007, NIPS.

[10]  Jiwen Lu,et al.  Discriminative Deep Metric Learning for Face and Kinship Verification , 2017, IEEE Transactions on Image Processing.

[11]  Hong-Yuan Mark Liao,et al.  Cross-Camera Knowledge Transfer for Multiview People Counting , 2015, IEEE Transactions on Image Processing.

[12]  Jin-Hui Zhu,et al.  Affordance Research in Developmental Robotics: A Survey , 2016, IEEE Transactions on Cognitive and Developmental Systems.