Image super-resolution via multi-resolution image sequence

A novel super-resolution reconstruction algorithm of multi-resolution image sequence integrating the improved super-resolution reconstruction based on neighbor embedding with scale invariant feature transform (SIFT) is proposed in this paper. Firstly, SIFT key points in images are extracted. Then SIFT-feature-based image registration is used to map input high-resolution images to target low-resolution images. Secondly, the mapped images are used as training images and the neighbor embedding is adopted to reconstruct the high-resolution image. The proposed method performs well for problems caused by image deformation, change in viewpoints and change in illumination, which ruin the quality of image super-resolution. Experiments show that the proposed method performs better in terms of lower quantitative errors and better high-frequency information preservation.

[1]  Shmuel Peleg,et al.  Image sequence enhancement using sub-pixel displacements , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[3]  William T. Freeman,et al.  Learning low-level vision , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[4]  Luca Lucchese,et al.  A noise-robust frequency domain technique for estimating planar roto-translations , 2000, IEEE Trans. Signal Process..

[5]  Takeo Kanade,et al.  Limits on super-resolution and how to break them , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[6]  Takeo Kanade,et al.  Limits on Super-Resolution and How to Break Them , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[8]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[9]  Hong Chang,et al.  Super-resolution through neighbor embedding , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[10]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[11]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[12]  Mahmood Fathy,et al.  Regional Varying Image Super-Resolution , 2009, 2009 International Joint Conference on Computational Sciences and Optimization.

[13]  Hyun Wook Park,et al.  A high-resolution image reconstuction method from low-resolution image sequence , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[14]  Hua Huang,et al.  Neighbor embedding based super-resolution algorithm through edge detection and feature selection , 2009, Pattern Recognit. Lett..

[15]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .