Autoregressive image interpolation via context modeling and multiplanar constraint

In this paper, we propose a novel image interpolation algorithm by context-aware autoregressive (AR) model and multiplanar constraint. Different from existing AR based methods which employ predetermined reference configuration to predict pixel values, the proposed method considers the anisotropic pixel dependencies in natural images and adaptively chooses the optimal prediction context by utilizing the nonlocal redundancy to interpolate pixels. Furthermore, the multiplanar constraint is applied to enhance the correlations within the estimation window by exploiting the self-similarity property of natural images. Similar patches are collected by the combination of patch-wise pixel values and the gradient information. And the inter-patch dependencies are adopted to improve the interpolation. The experimental results show that our method is effective in image interpolation and successfully decreases the artifacts nearby the sharp edges. The comparison experiments demonstrate that the proposed method can obtain better performance than other related ones in terms of both objective and subjective results.

[1]  Lei Zhang,et al.  Sparse Representation Based Image Interpolation With Nonlocal Autoregressive Modeling , 2013, IEEE Transactions on Image Processing.

[2]  Jie Ren,et al.  Similarity modulated block estimation for image interpolation , 2011, 2011 18th IEEE International Conference on Image Processing.

[3]  Wenjun Zhang,et al.  Adaptive Sequential Prediction of Multidimensional Signals With Applications to Lossless Image Coding , 2011, IEEE Transactions on Image Processing.

[4]  David H. Frakes,et al.  Segment Adaptive Gradient Angle Interpolation , 2013, IEEE Transactions on Image Processing.

[5]  Hsieh Hou,et al.  Cubic splines for image interpolation and digital filtering , 1978 .

[6]  Wenhan Yang,et al.  Novel autoregressive model based on adaptive window-extension and patch-geodesic distance for image interpolation , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[7]  Michael Elad,et al.  Single Image Interpolation Via Adaptive Nonlocal Sparsity-Based Modeling , 2014, IEEE Transactions on Image Processing.

[8]  Jie Ren,et al.  Adaptive General Scale Interpolation Based on Weighted Autoregressive Models , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Xiangjun Zhang,et al.  Image Interpolation by Adaptive 2-D Autoregressive Modeling and Soft-Decision Estimation , 2008, IEEE Transactions on Image Processing.

[10]  Rabab Kreidieh Ward,et al.  A New Orientation-Adaptive Interpolation Method , 2007, IEEE Transactions on Image Processing.

[11]  R. Keys Cubic convolution interpolation for digital image processing , 1981 .