Super-resolution by polar Newton-Thiele's rational kernel in centralized sparsity paradigm

In general the rectangular windows are used by many super-resolution reconstruction approaches, however, they are not suitable for the arc regions of images. In view of this, a novel reconstruction algorithm is proposed in this paper, which is based on the Newton-Thiele's rational interpolation by continued fractions in the polar coordinates. In order to get better reconstructed results, we also present a novel model where the Newton-Thiele's rational interpolation scheme used to magnify images/videos is combined with the sparse representation scheme used to refine the reconstructed results. Plenty of experiments in image and video sequences demonstrate that the new method can produce high-quality resolution enhancement, as compared with the state-of-the-art methods. Experimental results show that the proposed method achieves much better results than other methods in terms of both visual effect and PSNR. HighlightsThe Newton-Thiele's rational interpolation function in the polar coordinates is proposed.The nonlinear interpolation in the polar coordinates is applied to image and video SR reconstruction.The novel SR model by polar Newton-Thiele's rational kernel in centralized sparsity paradigm is presented.

[1]  Thomas S. Huang,et al.  Generative Bayesian Image Super Resolution With Natural Image Prior , 2012, IEEE Transactions on Image Processing.

[2]  Jiejie Zhu,et al.  Context-constrained hallucination for image super-resolution , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Masato Inoue,et al.  Posterior-Mean Super-Resolution With a Causal Gaussian Markov Random Field Prior , 2011, IEEE Transactions on Image Processing.

[4]  D. Yeung,et al.  Super-resolution through neighbor embedding , 2004, CVPR 2004.

[5]  Jieqing Tan,et al.  Composite schemes for multivariate blending rational interpolation , 2002 .

[6]  Thomas S. Huang,et al.  Coupled Dictionary Training for Image Super-Resolution , 2012, IEEE Transactions on Image Processing.

[7]  Wojciech Siemaszko,et al.  Thiele-tyoe branched continued fractions for two-variable functions , 1983 .

[8]  Xiaoyan Sun,et al.  Landmark Image Super-Resolution by Retrieving Web Images , 2013, IEEE Transactions on Image Processing.

[9]  Ying Wu,et al.  Super-Resolution Without Dense Flow , 2012, IEEE Transactions on Image Processing.

[10]  Jie Ren,et al.  Context-Aware Sparse Decomposition for Image Denoising and Super-Resolution , 2013, IEEE Transactions on Image Processing.

[11]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[12]  Ruimin Hu,et al.  Efficient single image super-resolution via graph-constrained least squares regression , 2013, Multimedia Tools and Applications.

[13]  Michal Irani,et al.  Super-resolution from a single image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[14]  Mario Bertero,et al.  Introduction to Inverse Problems in Imaging , 1998 .

[15]  Yi Fang,et al.  Newton-Thiele's rational interpolants , 2000, Numerical Algorithms.

[16]  Dinesh Rajan,et al.  Unified Blind Method for Multi-Image Super-Resolution and Single/Multi-Image Blur Deconvolution , 2013, IEEE Transactions on Image Processing.

[17]  Xuelong Li,et al.  Greedy regression in sparse coding space for single-image super-resolution , 2013, J. Vis. Commun. Image Represent..

[18]  Bhabatosh Chanda,et al.  Super Resolution Image Reconstruction Through Bregman Iteration Using Morphologic Regularization , 2012, IEEE Transactions on Image Processing.

[19]  Stephen Lin,et al.  Super resolution using edge prior and single image detail synthesis , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Wojciech Siemaszko,et al.  Rational approximation and interpolation of functions by branched continued fractions , 1987 .

[21]  Leonidas J. Guibas,et al.  Shape google: Geometric words and expressions for invariant shape retrieval , 2011, TOGS.

[22]  Lei Zhang,et al.  Centralized sparse representation for image restoration , 2011, 2011 International Conference on Computer Vision.

[23]  Sven Wanner,et al.  Variational Light Field Analysis for Disparity Estimation and Super-Resolution , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Lei Zhang,et al.  Image reconstruction with locally adaptive sparsity and nonlocal robust regularization , 2012, Signal Process. Image Commun..

[25]  Brigitte Verdonk,et al.  Multivariate reciprocal differences for branched Thiele continued fraction expansion , 1988 .

[26]  Lei Zhang,et al.  Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization , 2010, IEEE Transactions on Image Processing.

[27]  Xuelong Li,et al.  A multi-frame image super-resolution method , 2010, Signal Process..

[28]  Masato Inoue,et al.  Posterior mean super-resolution with a compound Gaussian Markov random field prior , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[29]  Xuelong Li,et al.  Joint Learning for Single-Image Super-Resolution via a Coupled Constraint , 2012, IEEE Transactions on Image Processing.

[30]  Thomas S. Huang,et al.  Image super-resolution as sparse representation of raw image patches , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[31]  Liangpei Zhang,et al.  Regional Spatially Adaptive Total Variation Super-Resolution With Spatial Information Filtering and Clustering , 2013, IEEE Transactions on Image Processing.

[32]  Liang Tang,et al.  Spatially Adaptive Block-Based Super-Resolution , 2012, IEEE Transactions on Image Processing.

[33]  Raanan Fattal,et al.  Image and video upscaling from local self-examples , 2011, TOGS.

[34]  Xuelong Li,et al.  Image Super-Resolution With Sparse Neighbor Embedding , 2012, IEEE Transactions on Image Processing.

[35]  Fei Zhou,et al.  Interpolation-Based Image Super-Resolution Using Multisurface Fitting , 2012, IEEE Transactions on Image Processing.

[36]  Jian-Huang Lai,et al.  Image super-resolution by textural context constrained visual vocabulary , 2012, Signal Process. Image Commun..

[37]  Nanning Zheng,et al.  Image hallucination with primal sketch priors , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[38]  Truong Q. Nguyen,et al.  Novel Example-Based Method for Super-Resolution and Denoising of Medical Images , 2014, IEEE Transactions on Image Processing.

[39]  Deqing Sun,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 on Bayesian Adaptive Video Super Resolution , 2022 .

[40]  Zhe L. Lin,et al.  Fast Image Super-Resolution Based on In-Place Example Regression , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Yi Sun,et al.  Video super resolution based on non-local regularization and reliable motion estimation , 2014, Signal Process. Image Commun..

[42]  Wojciech Siemaszko,et al.  Branched continued fractions for double power series , 1980 .

[43]  Xuelong Li,et al.  Single Image Super-Resolution With Non-Local Means and Steering Kernel Regression , 2012, IEEE Transactions on Image Processing.