Improved face recognition using super-resolution

Face recognition is a challenging task, especially when low-resolution images or image sequences are used. A decrease in image resolution typically results in loss of facial component details leading to a decrease in recognition rates. In this paper, we propose a new method for super-resolution by first learning the high-frequency components in the facial data that can be added to a low-resolution input image to create a super-resolved image. Our method is different from conventional methods as we estimate the high-frequency components, that are not used in other methods, to reconstruct a higher-resolution image, rather than studying the direct relationship between the high- and low-resolution images. Quantitative and qualitative results are reported for both synthetic and surveillance facial image databases.

[1]  Michael Elad,et al.  Fast and Robust Multi-Frame Super-Resolution , 2004, IEEE Transactions on Image Processing.

[2]  Takeo Kanade,et al.  Multi-PIE , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[3]  Rama Chellappa,et al.  Handbook of Remote Biometrics , 2009, Advances in Pattern Recognition.

[4]  Stan Z. Li,et al.  Face Recognition at a Distance: System Issues , 2009, Handbook of Remote Biometrics.

[5]  Shaogang Gong,et al.  Multi-modal tensor face for simultaneous super-resolution and recognition , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[6]  Thomas S. Huang,et al.  Image super-resolution as sparse representation of raw image patches , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  C. Taylor,et al.  Active shape models - 'Smart Snakes'. , 1992 .

[8]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Xiaoming Liu,et al.  Multi-Frame Image Restoration for Face Recognition , 2007 .

[10]  Jim Graham,et al.  Robust Active Shape Model Search , 2002, ECCV.

[11]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[12]  Gonzalo Pajares Martinsanz,et al.  A wavelet-based image fusion tutorial , 2004 .

[13]  Yang Li,et al.  An improved two-step approach to hallucinating faces , 2004, Third International Conference on Image and Graphics (ICIG'04).

[14]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[15]  Xiaoming Liu,et al.  Multi-Frame Super-Resolution for Face Recognition , 2007, 2007 First IEEE International Conference on Biometrics: Theory, Applications, and Systems.

[16]  Michael Elad,et al.  Sparse Representation for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[17]  C. C. Li,et al.  Application of wavelet-based POCS super-resolution for cardiovascular MRI image enhancement , 2004, Third International Conference on Image and Graphics (ICIG'04).

[18]  Yihong Gong,et al.  Resolution enhancement based on learning the sparse association of image patches , 2010, Pattern Recognit. Lett..

[19]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Takeo Kanade,et al.  Hallucinating faces , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[21]  Dao-Qing Dai,et al.  Face Recognition Using Dual-Tree Complex Wavelet Features , 2009, IEEE Transactions on Image Processing.

[22]  Harry Shum,et al.  A two-step approach to hallucinating faces: global parametric model and local nonparametric model , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[23]  Alaa Eleyan,et al.  Complex Wavelet Transform-Based Face Recognition , 2008, EURASIP J. Adv. Signal Process..

[24]  Josiane Zerubia,et al.  Wavelet-based superresolution in astronomy. , 2003 .

[25]  Pablo H. Hennings-Yeomans,et al.  Simultaneous super-resolution and feature extraction for recognition of low-resolution faces , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.