Weighted Encoding Based Image Interpolation With Nonlocal Linear Regression Model

An image interpolation model based on sparse representation is proposed. Two widely used priors including sparsity and nonlocal self-similarity are used as the regularization terms to boost the performance of the interpolation model. Meanwhile, we incorporate nonlocal linear regression into this model, since nonlocal similar patches could provide a better approximation to a given patch. Moreover, we propose a new approach to learn an adaptive sub-dictionary online instead of clustering. For each patch, similar patches are grouped to learn the adaptive sub-dictionary, generating a more sparse and accurate representation. Finally, weighted encoding is introduced to suppress tailing of fitting residuals in data fidelity. Abundant experimental results show that our proposed method achieves better performance compared to several state-of-the-art methods in terms of subjective and objective evaluations.

[1]  José M. Bioucas-Dias,et al.  Adaptive total variation image deblurring: A majorization-minimization approach , 2009, Signal Process..

[2]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[3]  Jian Yang,et al.  Mixed Noise Removal by Weighted Encoding With Sparse Nonlocal Regularization , 2014, IEEE Transactions on Image Processing.

[4]  Sheng Ren,et al.  Towards efficient medical lesion image super-resolution based on deep residual networks , 2019, Signal Process. Image Commun..

[5]  Lei Zhang,et al.  Nonlocally Centralized Sparse Representation for Image Restoration , 2013, IEEE Transactions on Image Processing.

[6]  Alan C. Bovik,et al.  Statistical Modeling of 3-D Natural Scenes With Application to Bayesian Stereopsis , 2011, IEEE Transactions on Image Processing.

[7]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[8]  Xue-Cheng Tai,et al.  Iterative Image Restoration Combining Total Variation Minimization and a Second-Order Functional , 2005, International Journal of Computer Vision.

[9]  Lei Zhang,et al.  Sparse Representation Based Image Interpolation With Nonlocal Autoregressive Modeling , 2013, IEEE Transactions on Image Processing.

[10]  Xiangjun Zhang,et al.  Image Interpolation by Adaptive 2-D Autoregressive Modeling and Soft-Decision Estimation , 2008, IEEE Transactions on Image Processing.

[11]  David Zhang,et al.  Two-stage image denoising by principal component analysis with local pixel grouping , 2010, Pattern Recognit..

[12]  Jon Atli Benediktsson,et al.  Hyperspectral Image Classification via Multiple-Feature-Based Adaptive Sparse Representation , 2017, IEEE Transactions on Instrumentation and Measurement.

[13]  Jian Yang,et al.  Image Super-Resolution via Deep Recursive Residual Network , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Zhou Wang,et al.  Image Quality Assessment: From Error Measurement to Structural Similarity , 2004 .

[15]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[16]  Michael Elad,et al.  Sparse Representation for Color Image Restoration , 2008, IEEE Transactions on Image Processing.

[17]  Stephen J. Wright,et al.  Computational Methods for Sparse Solution of Linear Inverse Problems , 2010, Proceedings of the IEEE.

[18]  Xue-Cheng Tai,et al.  A Weighted Dictionary Learning Model for Denoising Images Corrupted by Mixed Noise , 2013, IEEE Transactions on Image Processing.

[19]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[20]  Jack Yurkiewicz,et al.  Constrained optimization and Lagrange multiplier methods, by D. P. Bertsekas, Academic Press, New York, 1982, 395 pp. Price: $65.00 , 1985, Networks.

[21]  Shutao Li,et al.  Multifocus Image Fusion and Restoration With Sparse Representation , 2010, IEEE Transactions on Instrumentation and Measurement.

[22]  Shutao Li,et al.  Face Recognition by Exploiting Local Gabor Features With Multitask Adaptive Sparse Representation , 2015, IEEE Transactions on Instrumentation and Measurement.

[23]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Lei Zhang,et al.  Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization , 2010, IEEE Transactions on Image Processing.

[25]  Wotao Yin,et al.  Iteratively reweighted algorithms for compressive sensing , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[26]  Aggelos K. Katsaggelos,et al.  Total variation super resolution using a variational approach , 2008, 2008 15th IEEE International Conference on Image Processing.

[27]  Hsieh Hou,et al.  Cubic splines for image interpolation and digital filtering , 1978 .

[28]  Shutao Li,et al.  Target Detection Using Sparse Representation With Element and Construction Combination Feature , 2015, IEEE Transactions on Instrumentation and Measurement.

[29]  Viktor Gruev,et al.  Bilinear and bicubic interpolation methods for division of focal plane polarimeters. , 2011, Optics express.

[30]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[31]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[32]  Wen Gao,et al.  Image Interpolation Via Regularized Local Linear Regression , 2011, IEEE Transactions on Image Processing.

[33]  Wai Keung Wong,et al.  New semi-supervised classification using a multi-modal feature joint L21-norm based sparse representation , 2018, Signal Process. Image Commun..

[34]  Michael Elad,et al.  Single Image Interpolation Via Adaptive Nonlocal Sparsity-Based Modeling , 2014, IEEE Transactions on Image Processing.

[35]  Lei Zhang,et al.  An edge-guided image interpolation algorithm via directional filtering and data fusion , 2006, IEEE Transactions on Image Processing.

[36]  Stéphane Mallat,et al.  Super-Resolution With Sparse Mixing Estimators , 2010, IEEE Transactions on Image Processing.

[37]  Marc Teboulle,et al.  Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring Problems , 2009, IEEE Transactions on Image Processing.

[38]  Daniel Rueckert,et al.  Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[40]  Shuaiqi Liu,et al.  Multi-focus image fusion based on joint sparse representation and optimum theory , 2019, Signal Process. Image Commun..

[41]  R. Keys Cubic convolution interpolation for digital image processing , 1981 .

[42]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[43]  E.J. Candes Compressive Sampling , 2022 .

[44]  Jie Liu,et al.  Sparse representation and adaptive mixed samples regression for single image super-resolution , 2018, Signal Process. Image Commun..

[45]  Kyoung Mu Lee,et al.  Deeply-Recursive Convolutional Network for Image Super-Resolution , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[46]  Zhihui Wei,et al.  Edge-and-corner preserving regularization for image interpolation and reconstruction , 2008, Image Vis. Comput..