Improved face image super-resolution with restricted patch-searching area

Recently, an example-based super-resolution (SR) method specifically for face image, which takes the correspondence of facial parts into consideration, was proposed. The method constructs a database of face-image patches with their positions from example images of normalized faces. Given a low-resolution (LR) image, the method generates an SR image by finding similar patches in the database and incorporating high-frequency component of the patches to the LR image. Since the method just divides an example image into patches, for example, 5x5 patches in five-pixels intervals, the SR process may misses the chance to have the patch of the finest position. The proposed method generates patches in one-pixel intervals to increase the chance. In order to cope with the massively increased size of the patch database, the proposed method restricts the area to search the patch candidates for each position. An experimental result shows the proposed method achieves better results than the previous in term of the peak signal-to-noise ratio (PSNR). Furthermore, the proposed method has reduced computational time by 90% compared to the previous.

[1]  Tomonori Izumi,et al.  Example-based face image super-resolution taking into consideration correspondence of facial parts , 2017 .

[2]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[3]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[4]  William T. Freeman,et al.  Learning Low-Level Vision , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[5]  Jenn-Jier James Lien,et al.  Learning-Based Super-Resolution System Using Single Facial Image and Multi-resolution Wavelet Synthesis , 2007, ACCV.

[6]  Wan-Chi Siu,et al.  Single image super-resolution using Gaussian process regression , 2011, CVPR 2011.

[7]  Thomas S. Huang,et al.  Coupled Dictionary Training for Image Super-Resolution , 2012, IEEE Transactions on Image Processing.

[8]  Wan-Chi Siu,et al.  Review of image interpolation and super-resolution , 2012, Proceedings of The 2012 Asia Pacific Signal and Information Processing Association Annual Summit and Conference.

[9]  Takeo Kanade,et al.  Limits on super-resolution and how to break them , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[10]  Subhasis Chaudhuri,et al.  Single-Frame Image Super-resolution through Contourlet Learning , 2006, EURASIP J. Adv. Signal Process..

[11]  Zheng Liu,et al.  Single-image super-resolution based on Markov random field and contourlet transform , 2011, J. Electronic Imaging.