Adaptive lq-norm constrained general nonlocal self-similarity regularizer based sparse representation for single image super-resolution

Abstract Sparse representation (SR) with the traditional nonlocal self-similarity (NLSS) regularizer has a brilliant future in handling single image super-resolution (SISR) inverse problem. However, such NLSS regularizers proposed so far always favor the fixed lq-norm constraint, making it difficult to cater the statistical diversity of the image content. As a result, the reconstruction capability of SR model is adversely influenced. To cope with the drawback, we first devise an adaptive lq-norm constrained general NLSS regularizer, which can integrate the advantages of the traditional NLSS prior and the row NLSS prior and adaptively assign different q values to handle the different image contents, and then incorporate it into SR model. Moreover, previous works only consider the additive white Gaussian noise case and neglect to research the impulse noise case in SR based SISR framework. For this purpose, our work will further consider these factors. Finally, both the iteratively reweighted least squares and the standard iterative shrinkage algorithms are adopted for solving our SR model. Experiments reveal that the reconstruction capability of our method is better than many outstanding SISR reconstruction methods.

[1]  Chun Qi,et al.  Low-rank sparse representation for single image super-resolution via self-similarity learning , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[2]  Lei Zhang,et al.  AN adaptive L1–L2 hybrid error model to super-resolution , 2010, 2010 IEEE International Conference on Image Processing.

[3]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[4]  Peng Zhang,et al.  Adaptive rational fractal interpolation function for image super-resolution via local fractal analysis , 2019, Image Vis. Comput..

[5]  Weiguo Gong,et al.  Combining sparse representation and local rank constraint for single image super resolution , 2015, Inf. Sci..

[6]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[7]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[8]  Jun Yu,et al.  Coupled Deep Autoencoder for Single Image Super-Resolution , 2017, IEEE Transactions on Cybernetics.

[9]  Dacheng Tao,et al.  Non-Local Auto-Encoder With Collaborative Stabilization for Image Restoration , 2016, IEEE Transactions on Image Processing.

[10]  Vassilis Anastassopoulos,et al.  Super-resolution image reconstruction techniques: Trade-offs between the data-fidelity and regularization terms , 2012, Inf. Fusion.

[11]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[12]  Xiangjun Zhang,et al.  Image Interpolation by Adaptive 2-D Autoregressive Modeling and Soft-Decision Estimation , 2008, IEEE Transactions on Image Processing.

[13]  Thomas S. Huang,et al.  Deep Networks for Image Super-Resolution with Sparse Prior , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[14]  Michael Elad,et al.  A Statistical Prediction Model Based on Sparse Representations for Single Image Super-Resolution , 2014, IEEE Transactions on Image Processing.

[15]  Junjun Jiang,et al.  Single Image Super-Resolution via Locally Regularized Anchored Neighborhood Regression and Nonlocal Means , 2017, IEEE Transactions on Multimedia.

[16]  Guo Cao,et al.  Single image super-resolution via adaptive sparse representation and low-rank constraint , 2018, J. Vis. Commun. Image Represent..

[17]  Xuelong Li,et al.  Single Image Super-Resolution With Non-Local Means and Steering Kernel Regression , 2012, IEEE Transactions on Image Processing.

[18]  Guangming Shi,et al.  Denoising Prior Driven Deep Neural Network for Image Restoration , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Shutao Li,et al.  Super-resolution of hyperspectral image via superpixel-based sparse representation , 2018, Neurocomputing.

[20]  Jon Atli Benediktsson,et al.  Hyperspectral Image Classification via Multiple-Feature-Based Adaptive Sparse Representation , 2017, IEEE Transactions on Instrumentation and Measurement.

[21]  Stephen Lin,et al.  Super resolution using edge prior and single image detail synthesis , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Guangming Shi,et al.  Hyperspectral Image Super-Resolution via Non-Negative Structured Sparse Representation , 2016, IEEE Transactions on Image Processing.

[23]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.

[24]  Jon Atli Benediktsson,et al.  Spectral–Spatial Hyperspectral Image Classification via Multiscale Adaptive Sparse Representation , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Weiguo Gong,et al.  Dual-sparsity regularized sparse representation for single image super-resolution , 2015, Inf. Sci..

[26]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[28]  Yi Liu,et al.  Sparse representation based multi-sensor image fusion for multi-focus and multi-modality images: A review , 2018, Inf. Fusion.

[29]  Jie Li,et al.  Image super-resolution: The techniques, applications, and future , 2016, Signal Process..

[30]  Michael Elad,et al.  Robust shift and add approach to superresolution , 2003, SPIE Optics + Photonics.

[31]  Truong Q. Nguyen,et al.  Single Image Super-Resolution via Adaptive High-Dimensional Non-Local Total Variation and Adaptive Geometric Feature , 2017, IEEE Transactions on Image Processing.

[32]  D. Yeung,et al.  Super-resolution through neighbor embedding , 2004, CVPR 2004.

[33]  Feng Liu,et al.  Weighted Direct Nonlinear Regression for Effective Image Interpolation , 2019, IEEE Access.

[34]  Weiguo Gong,et al.  Combining edge difference with nonlocal self-similarity constraints for single image super-resolution , 2017, Neurocomputing.

[35]  R. Wolke,et al.  Iteratively Reweighted Least Squares: Algorithms, Convergence Analysis, and Numerical Comparisons , 1988 .

[36]  F. Cao,et al.  Image Super-Resolution via Adaptive $\ell _{p} (0, 2016, IEEE Transactions on Neural Networks and Learning Systems.

[37]  Ying Li,et al.  Cluster-based image super-resolution via jointly low-rank and sparse representation , 2016, J. Vis. Commun. Image Represent..

[38]  Shutao Li,et al.  Multispectral and hyperspectral image fusion with spatial-spectral sparse representation , 2019, Inf. Fusion.

[39]  Jinming Li Sparse representation based single image super-resolution with low-rank constraint and nonlocal self-similarity , 2017, Multimedia Tools and Applications.

[40]  Lei Zhang,et al.  Nonlocally Centralized Sparse Representation for Image Restoration , 2013, IEEE Transactions on Image Processing.

[41]  Truong Q. Nguyen,et al.  Enhanced Non-Local Total Variation Model and Multi-Directional Feature Prediction Prior for Single Image Super Resolution , 2019, IEEE Transactions on Image Processing.

[42]  Srimanta Mandal,et al.  Noise adaptive super-resolution from single image via non-local mean and sparse representation , 2017, Signal Process..

[43]  Harry Shum,et al.  Gradient Profile Prior and Its Applications in Image Super-Resolution and Enhancement , 2011, IEEE Transactions on Image Processing.

[44]  Wang Min High resolution radar imaging based on compressed sensing and adaptive Lp norm algorithm , 2011, Proceedings of 2011 IEEE CIE International Conference on Radar.

[45]  Lei Zhang,et al.  Deep Plug-And-Play Super-Resolution for Arbitrary Blur Kernels , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[46]  Zhenghua Zhou,et al.  Single image super-resolution based on adaptive convolutional sparse coding and convolutional neural networks , 2019, J. Vis. Commun. Image Represent..