Efficient Image Interpolation via Anchored Neighborhood Weighted Nonlinear Regression

We present an efficient and effective learning-based nonlinear image interpolation method in this paper. Our proposed method utilizes a single-hidden layer feed-forward neural network to mapping the local nonlinear relationship between high resolution patches and low resolution patches directly. In training phase, the training samples are firstly divide into 4 groups based on different known pixels pattern. For each group, a low resolution dictionary is trained and neighborhood are searched in the whole group data set for each atom which is regarded as an anchor. The searched neighborhoods for each anchor especially are then used for learning nonlinear regression model. In the interpolation phase, in order to further improve the interpolation performance, we weight the regression models of related anchors according to the similarity between input patch and anchors. With the off-line learned regression models, our method can achieve high computational efficiency. Extensive experimental results demonstrate the superior performance of our interpolation method compared with the state-of-the-art interpolation methods.

[1]  Moncef Gabbouj,et al.  Image Interpolation Based on Non-local Geometric Similarities and Directional Gradients , 2016, IEEE Trans. Multim..

[2]  Bing Zeng,et al.  MMSE-Directed Linear Image Interpolation Based on Nonlocal Geometric Similarity , 2017, IEEE Signal Processing Letters.

[3]  Wan-Chi Siu,et al.  Fast image interpolation with decision tree , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  Lei Zhang,et al.  Sparse Representation Based Image Interpolation With Nonlocal Autoregressive Modeling , 2013, IEEE Transactions on Image Processing.

[5]  Jaeseok Kim,et al.  A new edge directed interpolation algorithm using accurate estimation of edge directional covariance , 2012, 2012 IEEE International Symposium on Circuits and Systems.

[6]  M. Tech,et al.  Real Time Artifact-Free Image Upscaling , 2012 .

[7]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[8]  Luc Van Gool,et al.  A+: Adjusted Anchored Neighborhood Regression for Fast Super-Resolution , 2014, ACCV.

[9]  T. Lehmann,et al.  Addendum: B-spline interpolation in medical image processing , 2001, IEEE Transactions on Medical Imaging.

[10]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[11]  Kyoung Mu Lee,et al.  Accurate Image Super-Resolution Using Very Deep Convolutional Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Xin Li,et al.  Nonlinear image interpolation via deep neural network , 2017, 2017 51st Asilomar Conference on Signals, Systems, and Computers.

[13]  R. Keys Cubic convolution interpolation for digital image processing , 1981 .

[14]  Wen Gao,et al.  Image interpolation via regularized local linear regression , 2011, 28th Picture Coding Symposium.

[15]  Junjun Jiang,et al.  Single Image Super-Resolution via Locally Regularized Anchored Neighborhood Regression and Nonlocal Means , 2017, IEEE Transactions on Multimedia.

[16]  Xiangjun Zhang,et al.  Image Interpolation by Adaptive 2-D Autoregressive Modeling and Soft-Decision Estimation , 2008, IEEE Transactions on Image Processing.

[17]  Weiming Dong,et al.  Image zooming using directional cubic convolution interpolation , 2012 .

[18]  Wan-Chi Siu,et al.  Learning-based image interpolation via robust k-NN searching for coherent AR parameters estimation , 2015, J. Vis. Commun. Image Represent..

[19]  W. Siu,et al.  Fast image interpolation using the bilateral filter , 2012 .

[20]  Wan-Chi Siu,et al.  Robust Soft-Decision Interpolation Using Weighted Least Squares , 2012, IEEE Transactions on Image Processing.

[21]  Narendra Ahuja,et al.  Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolution , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Xiaoou Tang,et al.  Learning a Deep Convolutional Network for Image Super-Resolution , 2014, ECCV.

[23]  Wei Chen,et al.  A Fast Edge-Directed Interpolation Algorithm , 2012, ICONIP.

[24]  Luc Van Gool,et al.  Anchored Neighborhood Regression for Fast Example-Based Super-Resolution , 2013, 2013 IEEE International Conference on Computer Vision.

[25]  Lei Zhang,et al.  An edge-guided image interpolation algorithm via directional filtering and data fusion , 2006, IEEE Transactions on Image Processing.