Deep Convolutional Neural Network Used in Single Sample per Person Face Recognition

Face recognition (FR) with single sample per person (SSPP) is a challenge in computer vision. Since there is only one sample to be trained, it makes facial variation such as pose, illumination, and disguise difficult to be predicted. To overcome this problem, this paper proposes a scheme combined traditional and deep learning (TDL) method to process the task. First, it proposes an expanding sample method based on traditional approach. Compared with other expanding sample methods, the method can be used easily and conveniently. Besides, it can generate samples such as disguise, expression, and mixed variation. Second, it uses transfer learning and introduces a well-trained deep convolutional neural network (DCNN) model and then selects some expanding samples to fine-tune the DCNN model. Third, the fine-tuned model is used to implement experiment. Experimental results on AR face database, Extend Yale B face database, FERET face database, and LFW database demonstrate that TDL achieves the state-of-the-art performance in SSPP FR.

[1]  Jun-Ying Gan,et al.  A novel expanding sample method for single traning sample face recognition , 2017, 2017 International Conference on Wavelet Analysis and Pattern Recognition (ICWAPR).

[2]  Gang Wang,et al.  Discriminative multi-manifold analysis for face recognition from a single training sample per person , 2011, 2011 International Conference on Computer Vision.

[3]  Jun Guo,et al.  Extended SRC: Undersampled Face Recognition via Intraclass Variant Dictionary , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Aleix M. Martínez,et al.  Recognizing Imprecisely Localized, Partially Occluded, and Expression Variant Faces from a Single Sample per Class , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Zexuan Ji,et al.  Collaborative probabilistic labels for face recognition from single sample per person , 2017, Pattern Recognit..

[7]  Daoqiang Zhang,et al.  A new face recognition method based on SVD perturbation for single example image per person , 2005, Appl. Math. Comput..

[8]  Wen Gao,et al.  Adaptive generic learning for face recognition from a single sample per person , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Alejandro F. Frangi,et al.  Two-dimensional PCA: a new approach to appearance-based face representation and recognition , 2004 .

[10]  Junying Zeng,et al.  Single sample per person face recognition based on deep convolutional neural network , 2017, 2017 3rd IEEE International Conference on Computer and Communications (ICCC).

[11]  Haifeng Hu,et al.  Local robust sparse representation for face recognition with single sample per person , 2018, IEEE/CAA Journal of Automatica Sinica.

[12]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[13]  Shenghua Gao,et al.  Neither Global Nor Local: Regularized Patch-Based Representation for Single Sample Per Person Face Recognition , 2014, International Journal of Computer Vision.

[14]  Daoqiang Zhang,et al.  ( 2 D ) 2 PCA : 2-Directional 2-Dimensional PCA for Efficient Face Representation and Recognition , 2005 .

[15]  Zhenan Sun,et al.  A Lightened CNN for Deep Face Representation , 2015, ArXiv.

[16]  Lei Zhang,et al.  Local Generic Representation for Face Recognition with Single Sample per Person , 2014, ACCV.

[17]  Gang Wang,et al.  Discriminative multi-manifold analysis for face recognition from a single training sample per person , 2011, ICCV.

[18]  Wen Gao,et al.  Extended Fisherface for face recognition from a single example image per person , 2002, 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353).

[19]  Wei Li,et al.  Gait recognition with a single sample per person , 2016, 2016 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA).

[20]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Ming Zhu,et al.  Single sample per person face recognition with KPCANet and a weighted voting scheme , 2017, Signal, Image and Video Processing.

[22]  Yichuan Wang,et al.  Binarized features with discriminant manifold filters for robust single-sample face recognition , 2018, Signal Process. Image Commun..

[23]  Zhenmin Tang,et al.  Local structure based sparse representation for face recognition with single sample per person , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[24]  Daoqiang Zhang,et al.  Enhanced (PC)2 A for face recognition with one training image per person , 2004, Pattern Recognit. Lett..

[25]  Lei Zhang,et al.  Sparse Variation Dictionary Learning for Face Recognition with a Single Training Sample per Person , 2013, 2013 IEEE International Conference on Computer Vision.

[26]  Chung-Lin Huang,et al.  Single-sample-per-person-based face recognition using fast Discriminative Multi-manifold Analysis , 2014, Signal and Information Processing Association Annual Summit and Conference (APSIPA), 2014 Asia-Pacific.

[27]  Xiao-Yuan Jing,et al.  Generic Training Set based Multimanifold Discriminant Learning for Single Sample Face Recognition , 2018, KSII Trans. Internet Inf. Syst..

[28]  Guillaume-Alexandre Bilodeau,et al.  Synthetic face generation under various operational conditions in video surveillance , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[29]  David Beymer,et al.  Face recognition from one example view , 1995, Proceedings of IEEE International Conference on Computer Vision.

[30]  Qijun Zhao,et al.  Pose-Invariant Face Recognition via RGB-D Images , 2015, Comput. Intell. Neurosci..

[31]  Zhi-Hua Zhou,et al.  Recognizing partially occluded, expression variant faces from single training image per person with SOM and soft k-NN ensemble , 2005, IEEE Transactions on Neural Networks.

[32]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[33]  Simon C. K. Shiu,et al.  Multi-scale Patch Based Collaborative Representation for Face Recognition with Margin Distribution Optimization , 2012, ECCV.

[34]  Lei Zhang,et al.  Sparse representation or collaborative representation: Which helps face recognition? , 2011, 2011 International Conference on Computer Vision.

[35]  Jianxin Wu,et al.  Face recognition with one training image per person , 2002, Pattern Recognit. Lett..

[36]  Jun Guo,et al.  Robust, accurate and efficient face recognition from a single training image: A uniform pursuit approach , 2010, Pattern Recognit..

[37]  Tomaso Poggio,et al.  Image Representations for Visual Learning , 1996, Science.

[38]  Lihong Xu,et al.  A Modified Sparse Representation Method for Facial Expression Recognition , 2016, Comput. Intell. Neurosci..

[39]  Yan Zhang,et al.  Sample reconstruction with deep autoencoder for one sample per person face recognition , 2017, IET Comput. Vis..

[40]  LinLin Shen,et al.  Triple local feature based collaborative representation for face recognition with single sample per person , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[41]  Daoqiang Zhang,et al.  (2D)2PCA: Two-directional two-dimensional PCA for efficient face representation and recognition , 2005, Neurocomputing.

[42]  Jiwen Lu,et al.  Single Sample Face Recognition via Learning Deep Supervised Autoencoders , 2015, IEEE Transactions on Information Forensics and Security.

[43]  Dimitrios Hatzinakos,et al.  Projection into Expression Subspaces for Face Recognition from Single Sample per Person , 2013, IEEE Transactions on Affective Computing.

[44]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  David J. Kriegman,et al.  From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  Hanspeter Pfister,et al.  Maximizing all margins: Pushing face recognition with Kernel Plurality , 2011, 2011 International Conference on Computer Vision.

[47]  Zhi-Hua Zhou,et al.  Making FLDA applicable to face recognition with one sample per person , 2004, Pattern Recognit..

[48]  Yongjie Chu,et al.  Low-resolution face recognition with single sample per person , 2017, Signal Process..

[49]  Ying Li,et al.  Ensemble of Randomized Linear Discriminant Analysis for face recognition with single sample per person , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[50]  Ennio Mingolla,et al.  Mitigation of Effects of Occlusion on Object Recognition with Deep Neural Networks through Low-Level Image Completion , 2016, Comput. Intell. Neurosci..

[51]  Vijayan K. Asari,et al.  An improved face recognition technique based on modular PCA approach , 2004, Pattern Recognit. Lett..