Position-Patch Based Face Hallucination via High-Resolution Reconstructed-Weights Representation

Position-patch based face hallucination methods aim to reconstruct the high-resolution (HR) patch of each low-resolution (LR) input patch independently by the optimal linear combination of the training patches at the same position. Most of current approaches directly use the reconstruction weights learned from LR training set to generate HR face images, without considering the structure difference between LR and the HR feature space. However, it is reasonable to assume that utilizing HR images for weights learning would benefit the reconstruction process, because HR feature space generally contains much more information. Therefore, in this paper, we propose a novel representation scheme, called High-resolution Reconstructed-weights Representation (HRR), that allows us to improve an intermediate HR image into a more accurate one. Here the HR reconstruction weights can be effectively obtained by solving a least square problem. Our evaluations on publicly available face databases demonstrate favorable performance compared to the previous position-patch based methods.

[1]  Jian-Huang Lai,et al.  Face hallucination with imprecise-alignment using iterative sparse representation , 2014, Pattern Recognit..

[2]  Chia-Wen Lin,et al.  Cooperative face hallucination using multiple references , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[3]  Xiaogang Wang,et al.  Hallucinating face by eigentransformation , 2005, IEEE Trans. Syst. Man Cybern. Part C.

[4]  Kin-Man Lam,et al.  Face hallucination based on sparse local-pixel structure , 2014, Pattern Recognit..

[5]  Yueting Zhuang,et al.  Hallucinating faces: LPH super-resolution and neighbor reconstruction for residue compensation , 2007, Pattern Recognit..

[6]  Ruimin Hu,et al.  Position-Patch Based Face Hallucination via Locality-Constrained Representation , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[7]  Chun Qi,et al.  Hallucinating face by position-patch , 2010, Pattern Recognit..

[8]  Maoguo Gong,et al.  Position-Patch Based Face Hallucination Using Convex Optimization , 2011, IEEE Signal Processing Letters.

[9]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[10]  Yihong Gong,et al.  Nonlinear Learning using Local Coordinate Coding , 2009, NIPS.

[11]  Ruimin Hu,et al.  Locality-constraint iterative neighbor embedding for face hallucination , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[12]  Wai-kuen Cham,et al.  Hallucinating Face in the DCT Domain , 2011, IEEE Transactions on Image Processing.

[13]  Thomas S. Huang,et al.  Face hallucination VIA sparse coding , 2008, 2008 15th IEEE International Conference on Image Processing.

[14]  Takeo Kanade,et al.  Hallucinating faces , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[15]  Xuelong Li,et al.  A Comprehensive Survey to Face Hallucination , 2013, International Journal of Computer Vision.

[16]  D. Yeung,et al.  Super-resolution through neighbor embedding , 2004, CVPR 2004.