Motion based video super resolution using edge directed interpolation and complex wavelet transform

This paper proposes a novel super resolution technique using dual tree complex wavelet transform (DT-CWT) and new edge directional interpolation (NEDI) based on localizing motion blocks in consecutive frames. A super resolution process is applied on the extracted motion blocks and the static region of the frame to generate the low frequency subbands of DT-CWT. DT-CWT decomposition followed by NEDI generates the high frequency subbands in order to obtain the components required for inverse DT-CWT (IDT-CWT). Finally, the super resolved output frame is generated by composing the obtained high and low frequency subbands using IDT-CWT. Experimental results based on PSNR measures illustrate the advantage of proposed technique over the state of the art video resolution enhancement methods.

[1]  N. Kingsbury.  Image processing with complex wavelets , 1999, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[2]  Sabine Süsstrunk,et al.  A Frequency Domain Approach to Registration of Aliased Images with Application to Super-resolution , 2006, EURASIP J. Adv. Signal Process..

[3]  Michael Elad,et al.  Super Resolution With Probabilistic Motion Estimation , 2009, IEEE Transactions on Image Processing.

[4]  Michael Elad,et al.  Super-Resolution Without Explicit Subpixel Motion Estimation , 2009, IEEE Transactions on Image Processing.

[5]  Il-hong Shin,et al.  Image Resolution Enhancement using Inter-Subband Correlation in Wavelet Domain , 2007, 2007 IEEE International Conference on Image Processing.

[6]  Liangpei Zhang,et al.  A super-resolution reconstruction algorithm for hyperspectral images , 2012, Signal Process..

[7]  Jayanthi Pragatheeswaran,et al.  Image resolution enhancement based on edge directed interpolation using dual tree — Complex wavelet transform , 2011, 2011 International Conference on Recent Trends in Information Technology (ICRTIT).

[8]  Xuelong Li,et al.  A multi-frame image super-resolution method , 2010, Signal Process..

[9]  Klamer Schutte,et al.  Robust Fusion of Irregularly Sampled Data Using Adaptive Normalized Convolution , 2006, EURASIP J. Adv. Signal Process..

[10]  Michael Elad,et al.  Generalizing the Nonlocal-Means to Super-Resolution Reconstruction , 2009, IEEE Transactions on Image Processing.

[11]  Liangpei Zhang,et al.  A MAP Approach for Joint Motion Estimation, Segmentation, and Super Resolution , 2007, IEEE Transactions on Image Processing.

[12]  Gholamreza Anbarjafari,et al.  Video resolution enhancement by using complex wavelet transform , 2011, 2011 18th IEEE International Conference on Image Processing.

[13]  Ping Wah Wong,et al.  Edge-directed interpolation , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[14]  Gholamreza Anbarjafari,et al.  Discrete Wavelet Transform-Based Satellite Image Resolution Enhancement , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Gholamreza Anbarjafari,et al.  IMAGE Resolution Enhancement by Using Discrete and Stationary Wavelet Decomposition , 2011, IEEE Transactions on Image Processing.

[16]  Jin-Jang Leou,et al.  Video super-resolution reconstruction using a mobile search strategy and adaptive patch size , 2010, 2010 International Conference on Signal Processing and Multimedia Applications (SIGMAP).

[17]  HuangShih-Chia.  An Advanced Motion Detection Algorithm With Video Quality Analysis for Video Surveillance Systems , 2011 .

[18]  Aggelos K. Katsaggelos,et al.  High‐resolution images from compressed low‐resolution video: Motion estimation and observable pixels , 2004, Int. J. Imaging Syst. Technol..

[19]  Liangpei Zhang,et al.  A super-resolution reconstruction algorithm for surveillance images , 2010, Signal Process..

[20]  Shih-Chia Huang,et al.  An Advanced Motion Detection Algorithm With Video Quality Analysis for Video Surveillance Systems , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Thomas S. Huang,et al.  Non-Local Kernel Regression for Image and Video Restoration , 2010, ECCV.