Comparative analysis of deep network models through transfer learning

Deep learning has had remarkable success in several applications such as classification, clustering, regression etc. Several assumptions are made during the learning process which may not be apt for all real-world applications due to change in the feature space. For the classification task, deep learning models are most appropriate if a large amount of data is used for training. Therefore, enhancement is made from deep learning to transfer learning by knowledge transfer from feature space. In this paper, the accuracy obtained, number of iterations, and time taken for classification of various pre-trained networks is compared through transfer learning. The results reveal that the accuracy is higher when the training data is large compared to that with a small dataset.

[1]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Eduard Ayguadé,et al.  On the Behavior of Convolutional Nets for Feature Extraction , 2017, J. Artif. Intell. Res..

[3]  Rama Chellappa,et al.  Unconstrained face verification using deep CNN features , 2015, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[4]  Simon Haykin,et al.  GradientBased Learning Applied to Document Recognition , 2001 .

[5]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Jiwen Lu,et al.  Discriminative Deep Metric Learning for Face Verification in the Wild , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Xiangde Zhang,et al.  Feature Extraction and Fusion Using Deep Convolutional Neural Networks for Face Detection , 2017 .

[8]  Shan Sung Liew,et al.  Convolutional Neural Network for Face Recognition with Pose and Illumination Variation , 2014 .

[9]  Nasser M. Nasrabadi,et al.  Multi-Level Feature Abstraction from Convolutional Neural Networks for Multimodal Biometric Identification , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[10]  Xiaogang Wang,et al.  DeepID3: Face Recognition with Very Deep Neural Networks , 2015, ArXiv.

[11]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[13]  Weihong Deng,et al.  Deep face recognition with clustering based domain adaptation , 2020, Neurocomputing.

[14]  Lamiaa A. Elrefaei,et al.  Convolutional Neural Network Based Feature Extraction for IRIS Recognition , 2018 .

[15]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[16]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[17]  Gang Wang,et al.  Joint Feature Learning for Face Recognition , 2015, IEEE Transactions on Information Forensics and Security.

[18]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[19]  George S. Moschytz,et al.  Fingerprint Feature Extraction Using CNNs , 2001 .