Video super-resolution based on block motion estimation and gradient magnitude

Super-resolution (SR) technology aims to improve image resolution from a set of observed low resolution (LR) frames. This paper presents a new SR approach based on block motion estimation (ME) with gradient magnitude and the block types. ME is applied between a reference and its neighboring frames. If the motion is estimated inaccurately undesirable results are occurred at high resolution (HR) output frame. So, adaptive and static thresholds are used to eliminate improper blocks in registration. Outlier pixel detection is applied in reconstruction step. Finally, a deblurring process is performed on the HR frame. Proposed method results are compared with different interpolation methods. The experimental results are shown both peak-signal-to-noise ratio (PSNR) and as visually.

[1]  B. Marcel,et al.  3 - Calcul de translation et rotation par la transformation de Fourier , 1997 .

[2]  Michael Elad,et al.  Generalizing the Nonlocal-Means to Super-Resolution Reconstruction , 2009, IEEE Transactions on Image Processing.

[3]  Nikolas P. Galatsanos,et al.  Maximum a Posteriori Video Super-Resolution Using a New Multichannel Image Prior , 2010, IEEE Transactions on Image Processing.

[4]  George Wolberg,et al.  Digital image warping , 1990 .

[5]  Sabine Süsstrunk,et al.  A Frequency Domain Approach to Registration of Aliased Images with Application to Super-resolution , 2006, EURASIP J. Adv. Signal Process..

[6]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[7]  Michael Elad,et al.  Fast and Robust Multi-Frame Super-Resolution , 2004, IEEE Transactions on Image Processing.

[8]  Hasan Demirel,et al.  Motion block based video super resolution , 2013, Digit. Signal Process..

[9]  Y. Anagun,et al.  Super resolution using variable size block-matching motion estimation with rotation , 2012, 2012 International Symposium on Innovations in Intelligent Systems and Applications.

[10]  Michael Elad,et al.  Super-Resolution Reconstruction of Image Sequences , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[12]  R. Gerchberg.  Super-resolution through Error Energy Reduction , 1974 .

[13]  Roger Y. Tsai,et al.  Multiframe image restoration and registration , 1984 .

[14]  D. Yeung,et al.  Super-resolution through neighbor embedding , 2004, CVPR 2004.

[15]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[16]  Klamer Schutte,et al.  Robust Fusion of Irregularly Sampled Data Using Adaptive Normalized Convolution , 2006, EURASIP J. Adv. Signal Process..

[17]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[18]  Russell Zaretzki,et al.  Beta Process Joint Dictionary Learning for Coupled Feature Spaces with Application to Single Image Super-Resolution , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Raanan Fattal,et al.  Image and video upscaling from local self-examples , 2011, TOGS.

[20]  Eamon B. Barrett,et al.  Super-resolution image synthesis using projections onto convex sets in the frequency domain , 2005, IS&T/SPIE Electronic Imaging.

[21]  H Stark,et al.  High-resolution image recovery from image-plane arrays, using convex projections. , 1989, Journal of the Optical Society of America. A, Optics and image science.

[22]  A. Papoulis.  A new algorithm in spectral analysis and band-limited extrapolation. , 1975 .

[23]  Ming Gu,et al.  Advanced Motion Search and Adaptation Techniques for Deinterlacing , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[24]  Yonina C. Eldar,et al.  Characterization of Oblique Dual Frame Pairs , 2006, EURASIP J. Adv. Signal Process..

[25]  Shmuel Peleg,et al.  Improving image resolution using subpixel motion , 1987, Pattern Recognit. Lett..

[26]  Ken Turkowski,et al.  Filters for common resampling tasks , 1990 .