Learning-based image interpolation via robust k-NN searching for coherent AR parameters estimation

Learning-based image interpolation using precise and robust k-NN searching for an accurate AR modeling.Robustness to insufficient k-NN matches and adaptation to relevant k-NN matches during online searching.Online coherent soft-decision estimation of both local AR parameters and high-resolution pixels.Highly competitive performance compared with the state-of-the-art approaches in terms of PSNR and SSIM. Image interpolation is to convert a low-resolution (LR) image into a high-resolution (HR) image through mathematical modeling. An accurate model usually leads to a better reconstruction quality, and the autoregressive (AR) model is a widely adopted model for image interpolation. Although a large amount of works have been done on AR models for image interpolation, there are plenty of rooms for improvements. In this work, we propose a robust and precise k-nearest neighbors (k-NN) searching scheme to form an accurate AR model of the local statistic. We make use of both LR and HR information obtained from a large amount of training data, in order to form a coherent soft-decision estimation of both AR parameters and high-resolution pixels. Experimental results show that the proposed learning-based AR interpolation algorithm has a very competitive performance compared with the state-of-the-art image interpolation algorithms in terms of PSNR and SSIM values.

[1]  Jie Ren,et al.  Similarity modulated block estimation for image interpolation , 2011, 2011 18th IEEE International Conference on Image Processing.

[2]  Guangming Shi,et al.  Model-based adaptive resolution upconversion of degraded images , 2012, J. Vis. Commun. Image Represent..

[3]  Jin-Jang Leou,et al.  Saliency-directed color image interpolation using artificial neural network and particle swarm optimization , 2012, J. Vis. Commun. Image Represent..

[4]  Zhou Wang,et al.  Image Quality Assessment: From Error Measurement to Structural Similarity , 2004 .

[5]  Paolo Bientinesi,et al.  Fast computation of local correlation coefficients , 2008, Optical Engineering + Applications.

[6]  Bo Yan,et al.  Low complexity image interpolation method based on path selection , 2013, J. Vis. Commun. Image Represent..

[7]  Xiangjun Zhang,et al.  Image Interpolation by Adaptive 2-D Autoregressive Modeling and Soft-Decision Estimation , 2008, IEEE Transactions on Image Processing.

[8]  Xiaobai Sun,et al.  Fast computation of local correlation coefficients on graphics processing units , 2009, Optical Engineering + Applications.

[9]  Stéphane Mallat,et al.  Super-Resolution With Sparse Mixing Estimators , 2010, IEEE Transactions on Image Processing.

[10]  Wan-Chi Siu,et al.  Robust Soft-Decision Interpolation Using Weighted Least Squares , 2012, IEEE Transactions on Image Processing.

[11]  Li Chen,et al.  Hybrid image interpolation with soft-decision kernel regression , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[12]  A. Ardeshir Goshtasby,et al.  A Two-Stage Cross Correlation Approach to Template Matching , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[14]  Wen Gao,et al.  Image interpolation via regularized local linear regression , 2011, 28th Picture Coding Symposium.

[15]  Jie Ren,et al.  Adaptive general scale interpolation based on similar pixels weighting , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[16]  Truong Q. Nguyen,et al.  An Adaptable $k$ -Nearest Neighbors Algorithm for MMSE Image Interpolation , 2009, IEEE Transactions on Image Processing.

[17]  Lei Zhang,et al.  Sparse Representation Based Image Interpolation With Nonlocal Autoregressive Modeling , 2013, IEEE Transactions on Image Processing.

[18]  Lei Zhang,et al.  Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization , 2010, IEEE Transactions on Image Processing.