Low-Resolution Face Recognition Method Combining Super-Resolution and Improved DCR Model

Low-resolution face recognition is a challenging problem in the face recognition algorithm. Most face recognition algorithms have a significant reduction in recognition accuracy when facing low-resolution faces. In this paper, we propose a DCR(Deep Coupled ResNet) model based on super-resolution reconstruction, named SR-DCR model, to tackle this challenging. Firstly, we designed a super-resolution face reconstruction model based on the facial feature. The "perceptual loss + classification loss" is used as the loss function of the reconstructed network. And the facial feature is used to constrain the reconstruction process to make the reconstructed face more favorable for recognition. Then a series of improvements and adjustments were made to the DCR model. Improved the network structure of the main network, and its cross-layer connection method was changed to a close connection, which further promoted feature propagation in the network and enhanced feature reusability; The loss function of the main network is improved, and the improved "triplet loss" is used as a loss function to directly optimize the facial feature between high resolution and low-resolution, further enhancing the high and low resolution. The aggregation between facial features; at the same time, the training method of the DCR model is adjusted, and the steps of joint training between the main network and branch network are added to further optimize DCR network parameters. Finally, the super-resolution reconstruction and the improved DCR model are combined to recognize low-resolution faces. The performance of the proposed algorithm is compared with that of other advanced methods on LFW and SCFace datasets. Experimental results show that the algorithm improves the recognition rate by 3.5% based on DCR. Effectively improve the accuracy of face recognition at low resolution.

[1]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[3]  Xudong Jiang,et al.  Deep Coupled ResNet for Low-Resolution Face Recognition , 2018, IEEE Signal Processing Letters.

[4]  Thomas S. Huang,et al.  Coupled Dictionary Training for Image Super-Resolution , 2012, IEEE Transactions on Image Processing.

[5]  Xin Yu,et al.  Super-Resolving Very Low-Resolution Face Images with Supplementary Attributes , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[6]  Hua Huang,et al.  Super-Resolution Method for Face Recognition Using Nonlinear Mappings on Coherent Features , 2011, IEEE Transactions on Neural Networks.

[7]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Patrick J. Flynn,et al.  Multidimensional Scaling for Matching Low-Resolution Face Images , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Qingmin Liao,et al.  Discriminative Multidimensional Scaling for Low-Resolution Face Recognition , 2018, IEEE Signal Processing Letters.

[11]  Pong C. Yuen,et al.  Very low resolution face recognition problem , 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[12]  Xiaoou Tang,et al.  Learning a Deep Convolutional Network for Image Super-Resolution , 2014, ECCV.

[13]  Xianglei Xing,et al.  Couple manifold discriminant analysis with bipartite graph embedding for low-resolution face recognition , 2016, Signal Process..

[14]  King-Sun Fu,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Publication Information , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Mislav Grgic,et al.  SCface – surveillance cameras face database , 2011, Multimedia Tools and Applications.

[16]  Aggelos K. Katsaggelos,et al.  Bayesian combination of sparse and non-sparse priors in image super resolution , 2013, Digit. Signal Process..

[17]  Ruimin Hu,et al.  CDMMA: Coupled discriminant multi-manifold analysis for matching low-resolution face images , 2016, Signal Process..

[18]  Shiguang Shan,et al.  Low-Resolution Face Recognition via Coupled Locality Preserving Mappings , 2010, IEEE Signal Processing Letters.

[19]  Songcan Chen,et al.  Locality preserving CCA with applications to data visualization and pose estimation , 2007, Image Vis. Comput..

[20]  Lu Yang,et al.  Sparse representation and learning in visual recognition: Theory and applications , 2013, Signal Process..

[21]  Pengfei Shi,et al.  A Novel Method of Combined Feature Extraction for Recognition , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[22]  Ruimin Hu,et al.  Face image super-resolution through locality-induced support regression , 2014, Signal Process..

[23]  Hong Chang,et al.  Super-resolution through neighbor embedding , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[24]  Tieniu Tan,et al.  Cross-spectral Face Completion for NIR-VIS Heterogeneous Face Recognition , 2019, ArXiv.

[25]  Patrick J. Flynn,et al.  On Low-Resolution Face Recognition in the Wild: Comparisons and New Techniques , 2018, IEEE Transactions on Information Forensics and Security.

[26]  Junping Zhang,et al.  Super-resolution of human face image using canonical correlation analysis , 2010, Pattern Recognit..

[27]  Sivaram Prasad Mudunuri,et al.  Low Resolution Face Recognition Across Variations in Pose and Illumination , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Shihong Lao,et al.  Discriminant analysis in correlation similarity measure space , 2007, ICML '07.

[29]  Domingo Mery,et al.  Face recognition in low-quality images using adaptive sparse representations , 2019, Image Vis. Comput..

[30]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[32]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[33]  Shengcai Liao,et al.  Learning Face Representation from Scratch , 2014, ArXiv.