Single image super-resolution via multiple linear mapping anchored neighborhood regression

The goal of learning-based image super-resolution (SR) is to generate a plausible and visually high-resolution (HR) image from a single low-resolution (LR) input image. The SR is an important branch of image reconstruction that concentrates on the improvement of image resolution and the problem is severely underconstrained. It’s to rely on examples or some strong image priors to reconstruct the missing HR image details. The paper addresses the problem of learning the mapping functions is, projection matrix between the LR and HR images based on a dictionary of LR and HR exemplars. In this paper, we present a self-learning single image SR method, which restores an HR image from self-examples extracted from the LR input image itself without relying on additional external training images. This paper proposes a novel computationally to further improve the SR performance of single image SR method that learns multiple linear mappings (MLM) based on SR method functions anchored neighborhood regression (ANR) to directly transform LR feature subspaces into HR subspaces. Moreover, we utilize segmentation flipped and rotated with a matrix-vector of the self-examples to expand the internal patch space. Furthermore, we set up MLM from the input LR features to the desire HR outputs to obtain stable. In particular, we improved SR efficiency using optimization principal component analysis (OPCA) based on dimensionality reduction to generate from low-dimensional into high-dimensional with matrix-vector patch space. For our proposed model, there are three regularization parameters analysis that require to optimize the training and refine the outcome. Experimental result indicates that our approach comparison on the standard benchmark with state-of-the-art method validation the effectiveness of our proposed.

[1]  Xuelong Li,et al.  Partially Supervised Neighbor Embedding for Example-Based Image Super-Resolution , 2011, IEEE Journal of Selected Topics in Signal Processing.

[2]  Michal Irani,et al.  Super-resolution from a single image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[3]  Kwang In Kim,et al.  Single-Image Super-Resolution Using Sparse Regression and Natural Image Prior , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Zheng Wang,et al.  SRLSP: A Face Image Super-Resolution Algorithm Using Smooth Regression With Local Structure Prior , 2017, IEEE Transactions on Multimedia.

[5]  Xuelong Li,et al.  Image Super-Resolution With Sparse Neighbor Embedding , 2012, IEEE Transactions on Image Processing.

[6]  Hayit Greenspan,et al.  Super-Resolution in Medical Imaging , 2009, Comput. J..

[7]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[8]  Dit-Yan Yeung,et al.  Image Hallucination Using Neighbor Embedding over Visual Primitive Manifolds , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Richard A. Johnson,et al.  Applied Multivariate Statistical Analysis , 1983 .

[10]  Michael Elad,et al.  On Single Image Scale-Up Using Sparse-Representations , 2010, Curves and Surfaces.

[11]  Thomas S. Huang,et al.  Coupled Dictionary Training for Image Super-Resolution , 2012, IEEE Transactions on Image Processing.

[12]  Thomas S. Huang,et al.  Multiframe image restoration and registration , 1984 .

[13]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[14]  Luc Van Gool,et al.  Anchored Neighborhood Regression for Fast Example-Based Super-Resolution , 2013, 2013 IEEE International Conference on Computer Vision.

[15]  Ruimin Hu,et al.  Face Super-Resolution via Multilayer Locality-Constrained Iterative Neighbor Embedding and Intermediate Dictionary Learning , 2014, IEEE Transactions on Image Processing.

[16]  Junjun Jiang,et al.  Single Image Super-Resolution via Locally Regularized Anchored Neighborhood Regression and Nonlocal Means , 2017, IEEE Transactions on Multimedia.

[17]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[18]  Truong Q. Nguyen,et al.  Image Superresolution Using Support Vector Regression , 2007, IEEE Transactions on Image Processing.

[19]  Ruimin Hu,et al.  Noise Robust Face Hallucination via Locality-Constrained Representation , 2014, IEEE Transactions on Multimedia.

[20]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[21]  Zenggang Xiong,et al.  Optimized multiple linear mappings for single image super-resolution , 2017 .

[22]  Chi-Keung Tang,et al.  Fast image/video upsampling , 2008, SIGGRAPH 2008.

[23]  R. Keys Cubic convolution interpolation for digital image processing , 1981 .

[24]  Xuelong Li,et al.  Joint Learning for Single-Image Super-Resolution via a Coupled Constraint , 2012, IEEE Transactions on Image Processing.

[25]  Wan-Chi Siu,et al.  A Modified Edge Directed Interpolation for images , 2009, 2009 17th European Signal Processing Conference.

[26]  Xuelong Li,et al.  Learning Multiple Linear Mappings for Efficient Single Image Super-Resolution , 2015, IEEE Transactions on Image Processing.

[27]  Ruimin Hu,et al.  Noise robust position-patch based face super-resolution via Tikhonov regularized neighbor representation , 2016, Inf. Sci..

[28]  Nanning Zheng,et al.  Image hallucination with primal sketch priors , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[29]  Xuelong Li,et al.  Multi-scale dictionary for single image super-resolution , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[31]  Lizhe Wang,et al.  Fast and Scalable Multi-Way Analysis of Massive Neural Data , 2015, IEEE Transactions on Computers.

[32]  Xuelong Li,et al.  Single Image Super-Resolution With Multiscale Similarity Learning , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[33]  Lei Zhang,et al.  Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization , 2010, IEEE Transactions on Image Processing.

[34]  Xiaogang Wang,et al.  Image Transformation Based on Learning Dictionaries across Image Spaces , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Aline Roumy,et al.  Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding , 2012, BMVC.

[36]  Luc Van Gool,et al.  A+: Adjusted Anchored Neighborhood Regression for Fast Super-Resolution , 2014, ACCV.

[37]  Takeo Kanade,et al.  Limits on Super-Resolution and How to Break Them , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Peyman Milanfar,et al.  Kernel Regression for Image Processing and Reconstruction , 2007, IEEE Transactions on Image Processing.

[39]  Lizhe Wang,et al.  Reference Information Based Remote Sensing Image Reconstruction with Generalized Nonconvex Low-Rank Approximation , 2016, Remote. Sens..

[40]  Albert Y. Zomaya,et al.  Parallel Simulation of Complex Evacuation Scenarios with Adaptive Agent Models , 2015, IEEE Transactions on Parallel and Distributed Systems.

[41]  Ke Lu,et al.  Compressed Sensing of a Remote Sensing Image Based on the Priors of the Reference Image , 2015, IEEE Geoscience and Remote Sensing Letters.