The Effect of Task Similarity on Deep Transfer Learning

In recent years, with deep learning achieving a great success, deep transfer learning gradually becomes a new issue. Fine-tuning as a simple transfer learning method can be used to help train deep network and improve the performance of network. In our paper, we use two fine-tuning strategies on deep convolutional neural network and compare their results. There are many influencing factors, such as the depth and width of the network, the amount of data, the similarity of the source and target domain, and so on. Then we keep the network structure and other related factors consistent and use the fine fine-tuning strategy to find the effect of cross-domain factor and similarity of task. Specifically, we use source network and target test data to calculate the similarity. The results of experiments show that when we use fine-tune strategy, using different dataset in source and target domain would affect the target task a lot. Besides the similarity of tasks has direction, and to some extent the similarity would reflect the increment of performance of target task when the source and target task use the same dataset.

[1]  Dacheng Tao,et al.  Webly-Supervised Fine-Grained Visual Categorization via Deep Domain Adaptation , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[3]  Yun Fu,et al.  Task-driven deep transfer learning for image classification , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Ya Zhang,et al.  Part-Stacked CNN for Fine-Grained Visual Categorization , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Atsuto Maki,et al.  Factors of Transferability for a Generic ConvNet Representation , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[8]  Yizhou Yu,et al.  Borrowing Treasures from the Wealthy: Deep Transfer Learning through Selective Joint Fine-Tuning , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).