Face verification based on deep reconstruction network

Face verification is a difficult problem for the variations of illumination, expression and pose. Inspired by the denoising auto-encoder, a new deep learning algorithm named deep reconstruction network (DRN) is proposed to improve the face verification accuracy under these variations. In this proposed DRN, the input face containing variations is fed to the encoder and the target of the decoder is to reconstruct its reference version. With this object, the DRN models the input face as the reference face contaminated by the illumination, pose and expression, and thus the extracted facial features are insensitive to the three variations. Experimental results on the CMP-PIE dataset demonstrate that the DRN has good capability to reconstruct the reference face, and the facial features extracted by DRN have good robustness to obtain high face verification accuracy.

[1]  Shigeru Akamatsu Computer recognition of human face—A survey , 1999 .

[2]  Harry Shum,et al.  Automatic eyeglasses removal from face images , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[4]  Michael J. Jones,et al.  Fully automatic pose-invariant face recognition via 3D pose normalization , 2011, 2011 International Conference on Computer Vision.

[5]  Anastasios Tefas,et al.  Morphological elastic graph matching applied to frontal face authentication under optimal and real conditions , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[6]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression (PIE) database , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[7]  Michel Verleysen,et al.  Nonlinear Dimensionality Reduction , 2021, Computer Vision.

[8]  Xiaogang Wang,et al.  Recover Canonical-View Faces in the Wild with Deep Neural Networks , 2014, ArXiv.

[9]  Xiaogang Wang,et al.  Deep Learning Identity-Preserving Face Space , 2013, 2013 IEEE International Conference on Computer Vision.

[10]  Jiwen Lu,et al.  Single Sample Face Recognition via Learning Deep Supervised Autoencoders , 2015, IEEE Transactions on Information Forensics and Security.

[11]  Thomas Vetter,et al.  Face Recognition Based on Fitting a 3D Morphable Model , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[13]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression Database , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[15]  Rabab Kreidieh Ward,et al.  Component-wise pose normalization for pose-invariant face recognition , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.