Super Resolution from a Single Image Based on Self Similarity

A single image super resolution method based on self-similarity is proposed. It has been proposed that self-similarity occurs in the same image scales as the source image as well as across different image scales. We exploit this novel innovation to generate the image database, which is also referred to as image codebook, from two scales of the source image representing the relationship between low-frequency and high-frequency components. Thus, the missing high-frequency details in the resultant image to be enlarged are estimated by finding the nine nearest neighbors in the database with the low-frequency coming from the interpolation method. Then, the nine corresponding high-frequency components are weighted to add to the low-frequency to obtain the super-resolution image. Finally, a back-project operation is applied on the resultant image to ensure that the enlarged image is consistent with the source image as well as possible.

[1]  Noriaki Suetake,et al.  Image super-resolution based on local self-similarity , 2008 .

[2]  Heung-Yeung Shum,et al.  Fundamental limits of reconstruction-based superresolution algorithms under local translation , 2004 .

[3]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[4]  Sunil Arya,et al.  Approximate nearest neighbor queries in fixed dimensions , 1993, SODA '93.

[5]  Nikolas P. Galatsanos,et al.  Super-Resolution Based on Fast Registration and Maximum a Posteriori Reconstruction , 2007, IEEE Transactions on Image Processing.

[6]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[7]  Michal Irani,et al.  Super-resolution from a single image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[8]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[9]  Michael Elad,et al.  Fast and Robust Multi-Frame Super-Resolution , 2004, IEEE Transactions on Image Processing.

[10]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[11]  Takeo Kanade,et al.  Hallucinating faces , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).