Video Superresolution Reconstruction Using Iterative Back Projection with Critical-Point Filters Based Image Matching

To improve the spatial resolution of reconstructed images/videos, this paper proposes a Superresolution (SR) reconstruction algorithm based on iterative back projection. In the proposed algorithm, image matching using critical-point filters (CPF) is employed to improve the accuracy of image registration. First, a sliding window is used to segment the video sequence. CPF based image matching is then performed between frames in the window to obtain pixel-level motion fields. Finally, high-resolution (HR) frames are reconstructed based on the motion fields using iterative back projection (IBP) algorithm. The CPF based registration algorithm can adapt to various types of motions in real video scenes. Experimental results demonstrate that, compared to optical flow based imagematchingwith IBP algorithm, subjective quality improvement and an average PSNR score of 0.53 dB improvement are obtained by the proposed algorithm, when applied to video sequence.

[1]  Amar Mitiche,et al.  On convergence of the Horn and Schunck optical-flow estimation method , 2004, IEEE Transactions on Image Processing.

[2]  Roger Y. Tsai,et al.  Multiframe image restoration and registration , 1984 .

[3]  Frederic Dufaux,et al.  Motion estimation techniques for digital TV: a review and a new contribution , 1995, Proc. IEEE.

[4]  Jong Beom Ra,et al.  Example-Based Super-Resolution via Structure Analysis of Patches , 2013, IEEE Signal Processing Letters.

[5]  Xiaohai He,et al.  Video superresolution reconstruction based on subpixel registration and iterative back projection , 2009, J. Electronic Imaging.

[6]  Yong Hu,et al.  Video image super-resolution restoration based on iterative back-projection algorithm , 2009, 2009 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications.

[7]  Xiaohai He,et al.  An Improved Iterative Back-Projection Algorithm for Video Super-Resolution Reconstruction , 2010, 2010 Symposium on Photonics and Optoelectronics.

[8]  Chuangbai Xiao,et al.  A method of gibbs artifact reduction for POCS super-resolution image reconstruction , 2006 .

[9]  Hsieh Hou,et al.  Cubic splines for image interpolation and digital filtering , 1978 .

[10]  Jin Chen,et al.  Video Super-Resolution Using Generalized Gaussian Markov Random Fields , 2012, IEEE Signal Processing Letters.

[11]  Yoshihisa Shinagawa,et al.  Image Interpolation Using Enhanced Multiresolution Critical-Point Filters , 2004, International Journal of Computer Vision.

[12]  Sabine Süsstrunk,et al.  A Frequency Domain Approach to Registration of Aliased Images with Application to Super-resolution , 2006, EURASIP J. Adv. Signal Process..

[13]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[14]  Chuangbai Xiao,et al.  Edge Halo Reduction for Projections onto Convex Sets Super Resolution Image Reconstruction , 2012, 2012 International Conference on Digital Image Computing Techniques and Applications (DICTA).

[15]  Lingxiang Zheng,et al.  Image interpolation using multiresolutional critical point filters with unconstrained boundary extension , 2010, 2010 3rd International Congress on Image and Signal Processing.

[16]  Kenneth E. Barner,et al.  A Computationally Efficient Super-Resolution Algorithm for Video Processing Using Partition Filters , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  A. Murat Tekalp,et al.  Superresolution video reconstruction with arbitrary sampling lattices and nonzero aperture time , 1997, IEEE Trans. Image Process..

[18]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[19]  Tosiyasu L. Kunii,et al.  Unconstrained Automatic Image Matching Using Multiresolutional Critical-Point Filters , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Michael J. Black,et al.  Secrets of optical flow estimation and their principles , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.