Neighbor embedding based super-resolution algorithm through edge detection and feature selection

Assuming that the local geometry of low-resolution image patches is similar to that of the high-resolution counterparts, neighbor embedding based super-resolution methods learn a high-resolution image from one or more low-resolution input images by embedding its patches optimally with training ones. However, their performance suffers from inappropriate choices of features, neighborhood sizes and training patches. To address the issues, we propose an extended Neighbor embedding based super-resolution through edge detection and Feature Selection (henceforth NeedFS). Three major contributions of NeedFS are: (1) A new combination of features are proposed, which preserve edges and smoothen color regions better; (2) the training patches are learned discriminately with different neighborhood sizes based on edge detection; (3) only those edge training patches are bootstrapped to provide extra useful information with least redundancy. Experiments show that NeedFS performs better in both quantitative and qualitative evaluation. NeedFS is also robust even with a very limited training set and thus is promising for real applications.

[1]  William T. Freeman,et al.  Learning low-level vision , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[2]  Andrew Blake,et al.  Super-resolution Enhancement of Video , 2003, AISTATS.

[3]  Min Chen,et al.  Example selective and order independent learning-based image super-resolution , 2005, 2005 International Symposium on Intelligent Signal Processing and Communication Systems.

[4]  Shaogang Gong,et al.  Generalized Face Super-Resolution , 2008, IEEE Transactions on Image Processing.

[5]  Junping Zhang,et al.  An Improved Super-Resolution with Manifold Learning and Histogram Matching , 2006, ICB.

[6]  Dit-Yan Yeung,et al.  Image Hallucination Using Neighbor Embedding over Visual Primitive Manifolds , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Robert L. Stevenson,et al.  A Bayesian approach to image expansion for improved definitio , 1994, IEEE Trans. Image Process..

[8]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[9]  Peter Kovesi,et al.  Image Features from Phase Congruency , 1995 .

[10]  Takeo Kanade,et al.  Limits on super-resolution and how to break them , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[11]  Robert L. Stevenson,et al.  Super-resolution from image sequences-a review , 1998, 1998 Midwest Symposium on Circuits and Systems (Cat. No. 98CB36268).

[12]  Michael Elad,et al.  Super-Resolution Reconstruction of Image Sequences , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[14]  Mei Han,et al.  Soft Edge Smoothness Prior for Alpha Channel Super Resolution , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Truong Q. Nguyen,et al.  Image Superresolution Using Support Vector Regression , 2007, IEEE Transactions on Image Processing.

[16]  D. Yeung,et al.  Super-resolution through neighbor embedding , 2004, CVPR 2004.

[17]  Nicu Sebe,et al.  Neighborhood issue in single-frame image super-resolution , 2005, 2005 IEEE International Conference on Multimedia and Expo.