Dual-Geometric Neighbor Embedding for Image Super Resolution With Sparse Tensor

Neighbors embedding (NE) technology has proved its efficiency in single image super resolution (SISR). However, image patches do not strictly follow the similar structure in the low-resolution and high-resolution spaces, consequently leading to a bias to the image restoration. In this paper, considering that patches are a set of data with multiview characteristics and spatial organization, we advance a dual-geometric neighbor embedding (DGNE) approach for SISR. In DGNE, multiview features and local spatial neighbors of patches are explored to find a feature-spatial manifold embedding for images. We adopt a geometrically motivated assumption that for each patch there exists a small neighborhood in which only the patches that come from the same feature-spatial manifold, will lie approximately in a low-dimensional affine subspace formulated by sparse neighbors. In order to find the sparse neighbors, a tensor-simultaneous orthogonal matching pursuit algorithm is advanced to realize a joint sparse coding of feature-spatial image tensors. Some experiments are performed on realizing a 3X amplification of natural images, and the recovered results prove its efficiency and superiority to its counterparts.

[1]  Xuelong Li,et al.  Single Image Super-Resolution With Non-Local Means and Steering Kernel Regression , 2012, IEEE Transactions on Image Processing.

[2]  Shuyuan Yang,et al.  Multitask dictionary learning and sparse representation based single-image super-resolution reconstruction , 2011, Neurocomputing.

[3]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[4]  Lei Zhang,et al.  Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization , 2010, IEEE Transactions on Image Processing.

[5]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[6]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[7]  Dit-Yan Yeung,et al.  Image Hallucination Using Neighbor Embedding over Visual Primitive Manifolds , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[9]  Ruimin Hu,et al.  Efficient single image super-resolution via graph-constrained least squares regression , 2013, Multimedia Tools and Applications.

[10]  Xuelong Li,et al.  Image Quality Assessment Based on Multiscale Geometric Analysis , 2009, IEEE Transactions on Image Processing.

[11]  Stanley Osher,et al.  Image Super-Resolution by TV-Regularization and Bregman Iteration , 2008, J. Sci. Comput..

[12]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[13]  Nicu Sebe,et al.  Neighborhood issue in single-frame image super-resolution , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[14]  Michael Elad,et al.  On Single Image Scale-Up Using Sparse-Representations , 2010, Curves and Surfaces.

[15]  Yongdong Zhang,et al.  Multiview Spectral Embedding , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[16]  Junping Zhang,et al.  An Improved Super-Resolution with Manifold Learning and Histogram Matching , 2006, ICB.

[17]  Xuelong Li,et al.  Image Super-Resolution With Sparse Neighbor Embedding , 2012, IEEE Transactions on Image Processing.

[18]  Xuelong Li,et al.  Single-Image Super-Resolution via Sparse Coding Regression , 2011, 2011 Sixth International Conference on Image and Graphics.

[19]  Michal Irani,et al.  Super-resolution from a single image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[20]  Yiguang Chen,et al.  Single-Image Super-Resolution Reconstruction via Learned Geometric Dictionaries and Clustered Sparse Coding , 2012, IEEE Transactions on Image Processing.

[21]  Kwang In Kim,et al.  Single-Image Super-Resolution Using Sparse Regression and Natural Image Prior , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[23]  Xuelong Li,et al.  Joint Learning for Single-Image Super-Resolution via a Coupled Constraint , 2012, IEEE Transactions on Image Processing.

[24]  Xuelong Li,et al.  Single Image Super-Resolution With Multiscale Similarity Learning , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[25]  René Vidal,et al.  Sparse Manifold Clustering and Embedding , 2011, NIPS.

[26]  Andrzej Cichocki,et al.  Block sparse representations of tensors using Kronecker bases , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[27]  Xuelong Li,et al.  Partially Supervised Neighbor Embedding for Example-Based Image Super-Resolution , 2011, IEEE Journal of Selected Topics in Signal Processing.

[28]  Nanning Zheng,et al.  Image hallucination with primal sketch priors , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[29]  Hamid Abrishami Moghaddam,et al.  k/K-Nearest Neighborhood Criterion for Improving Locally Linear Embedding , 2009, 2009 Sixth International Conference on Computer Graphics, Imaging and Visualization.

[30]  Vassilios Morellas,et al.  Tensor Sparse Coding for Region Covariances , 2010, ECCV.

[31]  Hua Huang,et al.  Neighbor embedding based super-resolution algorithm through edge detection and feature selection , 2009, Pattern Recognit. Lett..

[32]  Ruimin Hu,et al.  Locality-constraint iterative neighbor embedding for face hallucination , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[33]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[34]  D. Yeung,et al.  Super-resolution through neighbor embedding , 2004, CVPR 2004.