A Novel Adaptive Directional Interpolation Algorithm for Digital Video Resolution Enhancement

In this paper, a novel digital video resolution enhancement algorithm based on adaptive directional interpolation is proposed, where the directionality of the edge structure and the nonlocal self-similarity prior within the current frame as well as its adjacent frames are both considered. First, we establish the regularization equation that conforms to the prior model of a video frame and then take the classic bicubic interpolation result as the initial estimation to iteratively solve the restoration equation, in which the edge structures and contours in low resolution (LR) input are reconstructed to estimate and refine the desired high resolution (HR) output. Experimental results show that the proposed algorithm can effectively enhance the clarity of a video frame, with satisfying subjective visual quality and PSNR value.

[1]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[2]  Chengyi Xiong,et al.  Single Image Interpolation Using Texture-Aware Low-Rank Regularization , 2018 .

[3]  Wei Chen,et al.  Nonlocal low-rank matrix completion for image interpolation using edge detection and neural network , 2014, Signal Image Video Process..

[4]  Michael Elad,et al.  Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing , 2010 .

[5]  Stéphane Mallat,et al.  Super-Resolution With Sparse Mixing Estimators , 2010, IEEE Transactions on Image Processing.

[6]  Hui Wang,et al.  A high quality single-image super-resolution algorithm based on linear Bayesian MAP estimation with sparsity prior , 2014, Digit. Signal Process..

[7]  Terrence J. Sejnowski,et al.  Learning Overcomplete Representations , 2000, Neural Computation.

[8]  Yixiang Lu,et al.  A MAP approach for image deblurring based on sparsity prior and Laplacian mixture modeling , 2017, 2017 32nd Youth Academic Annual Conference of Chinese Association of Automation (YAC).

[9]  Biao Hou,et al.  Adaptive Super-Resolution for Remote Sensing Images Based on Sparse Representation With Global Joint Dictionary Model , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Lei Zhang,et al.  Sparse Representation Based Image Interpolation With Nonlocal Autoregressive Modeling , 2013, IEEE Transactions on Image Processing.

[11]  Yixiang Lu,et al.  A dynamical analysis on non-local autoregressive model and its application on image reconstruction , 2020 .

[12]  Qingwei Gao,et al.  Image interpolation via collaging its non-local patches , 2016, Digit. Signal Process..

[13]  Thomas Martin Deserno,et al.  Survey: interpolation methods in medical image processing , 1999, IEEE Transactions on Medical Imaging.

[14]  Hasan Demirel,et al.  Motion based video super resolution using edge directed interpolation and complex wavelet transform , 2013, Signal Process..