A learning approach for single-frame face super-resolution

This paper presents a new learning approach for single-frame face super-resolution (SR). The aim of face SR is to estimate the missing high-resolution (HR) information from a single low-resolution (LR) face image by learning from training samples in the database. A commonly encountered issue in conventional face SR methods is that when the given LR image is a new face significantly different from those in the database, the quality of the reconstructed HR face is usually unsatisfactory. To alleviate this difficulty, we develop a new method to perform face SR based on principal component analysis (PCA) and locally linear embedding (LLE). The reconstructed HR face is able to preserve standard facial features and detailed local information through a residue prediction method using manifold learning. Experimental results show that the proposed method is effective in performing single-frame face SR.

[1]  Xiaogang Wang,et al.  Hallucinating face by eigentransformation , 2005, IEEE Trans. Syst. Man Cybern. Part C.

[2]  Harry Shum,et al.  A two-step approach to hallucinating faces: global parametric model and local nonparametric model , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[3]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[4]  Takeo Kanade,et al.  Hallucinating faces , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[5]  Nanning Zheng,et al.  Image hallucination with primal sketch priors , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[6]  Li Chen,et al.  Blind Super-Resolution Image Reconstruction using a Maximum a Posteriori Estimation , 2006, 2006 International Conference on Image Processing.

[7]  D. Yeung,et al.  Super-resolution through neighbor embedding , 2004, CVPR 2004.

[8]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[9]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..