Eigentransformation-based face super-resolution in the wavelet domain

In this paper, we propose a wavelet-based eigentransformation method for human face hallucination. Our algorithm uses the wavelet transform to decompose interpolated low-resolution (LR) images in the wavelet domain to obtain high-frequency information in three different directions, and employs the eigentransformation method to reconstruct the corresponding finer high-frequency content of the high-resolution (HR) images. The low-frequency content of the HR images in the wavelet domain is estimated based on the interpolated images directly. The resulting high-quality HR faces can be synthesized by using the inverse wavelet transform, with all the estimated coefficients. By combining interpolation and eigentransformation, the reconstructed images are less dependent on the training set selected, and can better preserve the low-frequency content. Thus, the reconstructed images look more like the ground-true HR images, as compared to the original eigentransformation method. Experimental results show that our proposed algorithm outperforms the original eigentransformation and other existing methods for face hallucination in terms of both visual quality and objective measurements.

[1]  Wen-Yu Su,et al.  Recursive high-resolution reconstruction of blurred multiframe images , 1993, IEEE Trans. Image Process..

[2]  Xiaogang Wang,et al.  Hallucinating face by eigentransformation , 2005, IEEE Trans. Syst. Man Cybern. Part C.

[3]  Kin-Man Lam,et al.  Example-based image super-resolution with class-specific predictors , 2009, J. Vis. Commun. Image Represent..

[4]  Takeo Kanade,et al.  Limits on Super-Resolution and How to Break Them , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Takeo Kanade,et al.  Limits on super-resolution and how to break them , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[6]  Russell C. Hardie,et al.  Joint MAP registration and high-resolution image estimation using a sequence of undersampled images , 1997, IEEE Trans. Image Process..

[7]  Martin Vetterli,et al.  Locally adaptive wavelet-based image interpolation , 2006, IEEE Transactions on Image Processing.

[8]  Thomas W. Parks,et al.  Adaptively quadratic (AQua) image interpolation , 2004, IEEE Transactions on Image Processing.

[9]  Rafael Robles,et al.  The convolution theorem for the continuous wavelet tranform , 2004, Signal Process..

[10]  Thomas W. Parks,et al.  Image interpolation using wavelet based hidden Markov trees , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[11]  Michael Elad,et al.  Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images , 1997, IEEE Trans. Image Process..

[12]  Kin-Man Lam,et al.  Wavelet-Based Eigentransformation for Face Super-Resolution , 2010, PCM.

[13]  Tsuhan Chen,et al.  Adaptive Markov Random Fields for Example-Based Super-resolution of Faces , 2006, EURASIP J. Adv. Signal Process..

[14]  Robert L. Stevenson,et al.  Extraction of high-resolution frames from video sequences , 1996, IEEE Trans. Image Process..

[15]  William T. Freeman,et al.  Learning Low-Level Vision , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[16]  Manjunath V. Joshi,et al.  New Learning Based Super-Resolution: Use of DWT and IGMRF Prior , 2010, IEEE Transactions on Image Processing.

[17]  Harry Wechsler,et al.  The FERET database and evaluation procedure for face-recognition algorithms , 1998, Image Vis. Comput..

[18]  Neil A. Dodgson,et al.  Quadratic interpolation for image resampling , 1997, IEEE Trans. Image Process..

[19]  Shaogang Gong,et al.  Hallucinating multiple occluded face images of different resolutions , 2006, Pattern Recognit. Lett..