Weakly-supervised deep self-learning for face recognition

For recent years, state-of-the-art deep learning systems for face recognition task completely use supervised training. Their performances depend critically on the amount of manually-labeled examples and the correctness of label data. In real life, however, it is very costly and time-consuming to collect and label such database. Therefore, we intend to build a feasible self-learning system, handling the face images which are unlabeled. In this paper, we first build a challenging unlabeled database and propose an efficient Self-Learning DCNN structure (SL-DCNN) to handle weakly-supervised training for face recognition using complicated and unlabeled training data. Our main contribution is that we introduce a novel modification signal as an ingenious supervision to distinguish the misclassifications, and to correctly reduce intra-class variations and enlarge inter-class distances in combination with identification-verification. Then, we investigate the method of feature merging and whether rich identity improves feature learning under unlabeled data. Finally, 97.47% face verification accuracy on LFW [1] is impressively achieved by our method, which is much higher than state-of-the-art methods under noise.

[1]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Xiaogang Wang,et al.  Hybrid Deep Learning for Face Verification , 2013, 2013 IEEE International Conference on Computer Vision.

[3]  David Flatow Stanford On the Robustness of ConvNets to Training on Noisy Labels , 2015 .

[4]  Xiaogang Wang,et al.  Deep Learning Face Representation by Joint Identification-Verification , 2014, NIPS.

[5]  Chunheng Wang,et al.  Deep nonlinear metric learning with independent subspace analysis for face verification , 2012, ACM Multimedia.

[6]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[7]  Honglak Lee,et al.  Learning hierarchical representations for face verification with convolutional deep belief networks , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Xiaogang Wang,et al.  Recover Canonical-View Faces in the Wild with Deep Neural Networks , 2014, ArXiv.

[9]  Xiaogang Wang,et al.  Deeply learned face representations are sparse, selective, and robust , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Qi Yin,et al.  Naive-Deep Face Recognition: Touching the Limit of LFW Benchmark or Not? , 2015, ArXiv.

[11]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[12]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[13]  Jian Sun,et al.  A Practical Transfer Learning Algorithm for Face Verification , 2013, 2013 IEEE International Conference on Computer Vision.

[14]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[15]  Dumitru Erhan,et al.  Training Deep Neural Networks on Noisy Labels with Bootstrapping , 2014, ICLR.

[16]  Jian Sun,et al.  Blessing of Dimensionality: High-Dimensional Feature and Its Efficient Compression for Face Verification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[18]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.