Deep Learning Based Single Sample Per Person Face Recognition: A Survey

Face recognition has been an active research area in the field of pattern recognition, especially since the rise of deep learning in recent years. However, in some practical situations, each identity in the training set has only a single sample. This type of situation is called Single Sample Per Person (SSPP), which brings a great challenge to the effective training of deep models. To resolve this issue, and to unleash the full potential of deep learning, many deep learning based SSPP face recognition methods have been proposed in recent years. There have been several comprehensive surveys for traditional methods based SSPP face recognition approaches, but emerging deep learning based methods are rarely involved. In this paper, we focus on those deep methods, classifying them as virtual sample methods and generic learning methods. In virtual sample methods, virtual face images or virtual face features are generated to benefit the training of the deep model. In generic learning methods, additional multi-sample generic set are used. Efforts of traditional methods and deep feature combining, loss function improving and network structure improving are involved in our analysis in the generic learning methods section. Finally, we discuss existing problems of identity information retention in virtual sample methods and domain adaption in generic learning methods. Further, we regard the semantic gap as an important future issue that needs to be considered in deep SSPP methods.

[1]  Mohammed Ouanan,et al.  Non-linear dictionary representation of deep features for face recognition from a single sample per person , 2018 .

[2]  LinLin Shen,et al.  Joint and collaborative representation with local adaptive convolution feature for face recognition with single sample per person , 2017, Pattern Recognit..

[3]  Xiaogang Wang,et al.  Deep Learning Identity-Preserving Face Space , 2013, 2013 IEEE International Conference on Computer Vision.

[4]  Weihong Deng,et al.  One-shot deep neural network for pose and illumination normalization face recognition , 2016, 2016 IEEE International Conference on Multimedia and Expo (ICME).

[5]  Demetri Terzopoulos,et al.  Multilinear subspace analysis of image ensembles , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[6]  Pietro Perona,et al.  One-shot learning of object categories , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Hyun Seung Yang,et al.  SSPP-DAN: Deep domain adaptation network for face recognition with single sample per person , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[8]  Shiguang Shan,et al.  Adaptive discriminant learning for face recognition , 2013, Pattern Recognit..

[9]  Tian Zhuo Face recognition from a single image per person using deep architecture neural networks , 2015, Cluster Computing.

[10]  Eric Granger,et al.  CNNs with cross-correlation matching for face recognition in video surveillance using a single training sample per person , 2017, 2017 14th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[11]  Rabab Kreidieh Ward,et al.  Single image per person face recognition with images synthesized by non-linear approximation , 2008, 2008 15th IEEE International Conference on Image Processing.

[12]  Kyungmin Kim,et al.  Face Generation for Low-Shot Learning Using Generative Adversarial Networks , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[13]  Giuliano Grossi,et al.  Robust Single-Sample Face Recognition by Sparsity-Driven Sub-Dictionary Learning Using Deep Features † , 2019, Sensors.

[14]  David Zhang,et al.  Convolutional Network for Attribute-driven and Identity-preserving Human Face Generation , 2016, ArXiv.

[15]  LinLin Shen,et al.  Adaptive convolution local and global learning for class-level joint representation of face recognition with single sample per person , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[16]  Yu Cheng,et al.  Know You at One Glance: A Compact Vector Representation for Low-Shot Learning , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[17]  Ming Zhu,et al.  Single sample per person face recognition with KPCANet and a weighted voting scheme , 2017, Signal Image Video Process..

[18]  Xiaogang Wang,et al.  Multi-View Perceptron: a Deep Model for Learning Face Identity and View Representations , 2014, NIPS.

[19]  Wen Gao,et al.  Adaptive generic learning for face recognition from a single sample per person , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Geoffrey E. Hinton,et al.  Deep Lambertian Networks , 2012, ICML.

[21]  Xiang Yu,et al.  Feature Transfer Learning for Face Recognition With Under-Represented Data , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Jiwen Lu,et al.  Single Sample Face Recognition via Learning Deep Supervised Autoencoders , 2015, IEEE Transactions on Information Forensics and Security.

[23]  Giuliano Grossi,et al.  Single Sample Face Recognition by Sparse Recovery of Deep-Learned LDA Features , 2018, ACIVS.

[24]  Yuting Zhang,et al.  Learning to Disentangle Factors of Variation with Manifold Interaction , 2014, ICML.

[25]  Victor Lempitsky,et al.  Few-Shot Adversarial Learning of Realistic Neural Talking Head Models , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[26]  Yan Zhang,et al.  Sample reconstruction with deep autoencoder for one sample per person face recognition , 2017, IET Comput. Vis..

[27]  David Zhang,et al.  Deep Cascade Model-Based Face Recognition: When Deep-Layered Learning Meets Small Data , 2020, IEEE Transactions on Image Processing.

[28]  Jiwen Lu,et al.  PCANet: A Simple Deep Learning Baseline for Image Classification? , 2014, IEEE Transactions on Image Processing.

[29]  Yiu-ming Cheung,et al.  Synergistic Generic Learning for Face Recognition From a Contaminated Single Sample per Person , 2020, IEEE Transactions on Information Forensics and Security.

[30]  Zhi-Hua Zhou,et al.  Face recognition from a single image per person: A survey , 2006, Pattern Recognit..

[31]  Yandong Guo,et al.  Generative One-Shot Face Recognition , 2019, ArXiv.

[32]  Yuhua Ding,et al.  Learning Low-Rank Regularized Generic Representation With Block-Sparse Structure for Single Sample Face Recognition , 2019, IEEE Access.

[33]  Eric Granger,et al.  Video-based face recognition using ensemble of haar-like deep convolutional neural networks , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[34]  Lei Zhang,et al.  One-shot Face Recognition by Promoting Underrepresented Classes , 2017, ArXiv.

[35]  Galina Lavrentyeva,et al.  Doppelganger Mining for Face Representation Learning , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[36]  Lei Zhang,et al.  One-Shot Face Recognition via Generative Learning , 2018, 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018).

[37]  Zhenmin Tang,et al.  Local structure based sparse representation for face recognition with single sample per person , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[38]  Lingxiao Wang,et al.  Feature Learning for One-Shot Face Recognition , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[39]  Shuang Wang,et al.  Fuzzy Sparse Autoencoder Framework for Single Image Per Person Face Recognition , 2018, IEEE Transactions on Cybernetics.

[40]  Aiguo Song,et al.  Face recognition using m-MSD and SVD with single training image , 2011, Proceedings of the 30th Chinese Control Conference.

[41]  Aleix M. Martínez,et al.  Recognizing Imprecisely Localized, Partially Occluded, and Expression Variant Faces from a Single Sample per Class , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  Alessandro Adamo,et al.  Sparse Representation Based Classification for Face Recognition by k-LiMapS Algorithm , 2012, ICISP.

[43]  Jie Wang,et al.  On solving the face recognition problem with one training sample per subject , 2006, Pattern Recognit..

[44]  Raul Queiroz Feitosa,et al.  Single Sample Face Recognition from Video via Stacked Supervised Auto-Encoder , 2016, 2016 29th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI).

[45]  Yun Fu,et al.  Low-Shot Face Recognition with Hybrid Classifiers , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[46]  Alan L. Yuille,et al.  Semi-Supervised Sparse Representation Based Classification for Face Recognition With Insufficient Labeled Samples , 2016, IEEE Transactions on Image Processing.

[47]  Seyyed Ali Seyyedsalehi,et al.  Improving face recognition from a single image per person via virtual images produced by a bidirectional network , 2012 .

[48]  Jun Guo,et al.  Equidistant prototypes embedding for single sample based face recognition with generic learning and incremental learning , 2014, Pattern Recognit..

[49]  David Zhang,et al.  Fisher Discrimination Dictionary Learning for sparse representation , 2011, 2011 International Conference on Computer Vision.

[50]  Dacheng Tao,et al.  Trunk-Branch Ensemble Convolutional Neural Networks for Video-Based Face Recognition , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  Junying Zeng,et al.  Single sample per person face recognition based on deep convolutional neural network , 2017, 2017 3rd IEEE International Conference on Computer and Communications (ICCC).

[52]  Yan Song,et al.  Local structure based multi-phase collaborative representation for face recognition with single sample per person , 2016, Inf. Sci..