When Spatially-Variant Filtering Meets Low-Rank Regularization: Exploiting Non-Local Similarity for Single Image Interpolation

This paper combines spatially-variant filtering and non-local low-rank regularization (NLR) to exploit non-local similarity in natural images in addressing the problem of image interpolation. We propose to build a carefully designed spatially-variant, non-local filtering scheme to generate a reliable estimate of the interpolated image and utilize NLR to refine the estimation. Our work uses a simple, parallelizable algorithm without the need to solve complicated optimization problems. Experiment results demonstrate that our algorithm significantly improves PSNR and SSIM of the interpolated images compared with state-of-the-art algorithms.

[1]  Moncef Gabbouj,et al.  Image Interpolation Based on Non-local Geometric Similarities and Directional Gradients , 2016, IEEE Trans. Multim..

[2]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[3]  Jean-Michel Morel,et al.  Self-Similarity Driven Color Demosaicking , 2009, IEEE Transactions on Image Processing.

[4]  Lantao Yu,et al.  Single Image Interpolation Exploiting Semi-local Similarity , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[5]  A. Baudes,et al.  A Nonlocal Algorithm for Image Denoising , 2005, CVPR 2005.

[6]  Ashok Kumar,et al.  Image interpolation by adaptive 2-D autoregressive modeling , 2010, International Conference on Digital Image Processing.

[7]  Huifang Sun,et al.  Image interpolation via graph-based Bayesian label propagation. , 2014, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[8]  A. E. Hoerl,et al.  Ridge regression: biased estimation for nonorthogonal problems , 2000 .

[9]  Michael Elad,et al.  Single Image Interpolation Via Adaptive Nonlocal Sparsity-Based Modeling , 2014, IEEE Transactions on Image Processing.

[10]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[11]  Lei Zhang,et al.  Weighted Nuclear Norm Minimization and Its Applications to Low Level Vision , 2016, International Journal of Computer Vision.

[12]  Qingwei Gao,et al.  Image interpolation via collaging its non-local patches , 2016, Digit. Signal Process..

[13]  Wen Gao,et al.  Image interpolation via regularized local linear regression , 2011, 28th Picture Coding Symposium.

[14]  Michael T. Orchard,et al.  Location-Directed Image Modeling and its Application to Image Interpolation , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[15]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[16]  Hongyuan Zha,et al.  Multiscale Semilocal Interpolation With Antialiasing , 2012, IEEE Transactions on Image Processing.

[17]  Guangming Shi,et al.  Compressive Sensing via Nonlocal Low-Rank Regularization , 2014, IEEE Transactions on Image Processing.

[18]  Lei Zhang,et al.  Sparse Representation Based Image Interpolation With Nonlocal Autoregressive Modeling , 2013, IEEE Transactions on Image Processing.