Identity Aware Synthesis for Cross Resolution Face Recognition

Enhancing low resolution images via super-resolution or synthesis algorithms for cross-resolution face recognition has been well studied. Several image processing and machine learning paradigms have been explored for addressing the same. In this research, we propose Synthesis via Hierarchical Sparse Representation (SHSR) algorithm for synthesizing a high resolution face image from a low resolution input image. The proposed algorithm learns multilevel sparse representation for both high and low resolution gallery images, along with identity aware dictionaries and a transformation function between the two representations for face identification scenarios. With low resolution test data as input, a high resolution test image is synthesized using the identity aware dictionaries and transformation, which is then used for face recognition. The performance of the proposed SHSR algorithm is evaluated on four datasets, including one real world dataset. Experimental results and comparison with seven existing algorithms demonstrate the efficacy of the proposed algorithm in terms of both face identification and image quality measures.

[1]  Mohammad Norouzi,et al.  Pixel Recursive Super Resolution , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[2]  Quan Pan,et al.  Semi-coupled dictionary learning with applications to image super-resolution and photo-sketch synthesis , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Tejas I. Dhamecha,et al.  Recognizing Disguised Faces: Human and Machine Evaluation , 2014, PloS one.

[4]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[5]  Michael Elad,et al.  A Statistical Prediction Model Based on Sparse Representations for Single Image Super-Resolution , 2014, IEEE Transactions on Image Processing.

[6]  Richa Singh,et al.  Face identification from low resolution near-infrared images , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[7]  Andreas Spanias,et al.  Multilevel dictionary learning for sparse representation of images , 2011, 2011 Digital Signal Processing and Signal Processing Education Meeting (DSP/SPE).

[8]  Patrick J. Flynn,et al.  Assessment of Time Dependency in Face Recognition: An Initial Study , 2003, AVBPA.

[9]  Himanshu S. Bhatt,et al.  Submitted to Ieee Transactions on Image Processing 1 Improving Cross-resolution Face Matching Using Ensemble Based Co-transfer Learning , 2022 .

[10]  Jiquan Ngiam,et al.  Sparse Filtering , 2011, NIPS.

[11]  Michael Elad,et al.  Double Sparsity: Learning Sparse Dictionaries for Sparse Signal Approximation , 2010, IEEE Transactions on Signal Processing.

[12]  Lawrence Carin,et al.  A Bayesian Nonparametric Approach to Image Super-Resolution , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Rama Chellappa,et al.  Disguised Faces in the Wild , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[14]  Yu-Chiang Frank Wang,et al.  Recognition at a long distance: Very low resolution face recognition and hallucination , 2015, 2015 International Conference on Biometrics (ICB).

[15]  Kin-Man Lam,et al.  Simultaneous Hallucination and Recognition of Low-Resolution Faces Based on Singular Value Decomposition , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Richa Singh,et al.  MDLFace: Memorability augmented deep learning for video face recognition , 2014, IEEE International Joint Conference on Biometrics.

[17]  Richa Singh,et al.  Disguise detection and face recognition in visible and thermal spectrums , 2013, 2013 International Conference on Biometrics (ICB).

[18]  Lei Zhang,et al.  Convolutional Sparse Coding for Image Super-Resolution , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[19]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Kwang In Kim,et al.  Single-Image Super-Resolution Using Sparse Regression and Natural Image Prior , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Craig I. Watson,et al.  NIST special database 32 multiple encounter dataset II (MEDS-II) :: data description document , 2009 .

[22]  Xuelong Li,et al.  A Comprehensive Survey to Face Hallucination , 2013, International Journal of Computer Vision.

[23]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Tong Tong,et al.  Image Super-Resolution Using Dense Skip Connections , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[25]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[26]  Xiaoou Tang,et al.  Accelerating the Super-Resolution Convolutional Neural Network , 2016, ECCV.

[27]  Wen Gao,et al.  The CAS-PEAL Large-Scale Chinese Face Database and Baseline Evaluations , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[28]  Sivaram Prasad Mudunuri,et al.  Low Resolution Face Recognition Across Variations in Pose and Illumination , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Takeo Kanade,et al.  Multi-PIE , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[30]  Mayank Vatsa,et al.  Deep Dictionary Learning , 2016, IEEE Access.

[31]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[32]  Rajat Raina,et al.  Efficient sparse coding algorithms , 2006, NIPS.

[33]  Q. M. Jonathan Wu,et al.  Low-resolution face recognition: a review , 2013, The Visual Computer.

[34]  Mislav Grgic,et al.  SCface – surveillance cameras face database , 2011, Multimedia Tools and Applications.

[35]  Yu-Chiang Frank Wang,et al.  Learning guided convolutional neural networks for cross-resolution face recognition , 2017, 2017 IEEE 27th International Workshop on Machine Learning for Signal Processing (MLSP).

[36]  Thomas S. Huang,et al.  Studying Very Low Resolution Recognition Using Deep Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Takeo Kanade,et al.  Hallucinating faces , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).