A content-adaptive image enlargement scheme based on iterative back-projection

In this paper, we propose an adaptive image enlargement scheme based on iterative back-projection. Initial estimates of each enlarged image can be individually created from the spatial and temporal domains by using sub-pixel interpolation and sub-pixel motion estimation. Then, based on the initial estimates and image content, reconstructed images are derived by using a modified iterative back-projection technique and fused into an enlarged image. Finally, a low-pass filter as a post-processing is applied to reduce the blocking artifacts in the reconstructed high-resolution images. Our experiment results demonstrate that, in terms of PSNR and NQM, the proposed scheme is superior to existing methods.

[1]  Ming-Sui Lee,et al.  A Content-Adaptive Up-Sampling Technique for Image Resolution Enhancement , 2007, Third International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP 2007).

[2]  Shmuel Peleg,et al.  Improving image resolution using subpixel motion , 1987, Pattern Recognit. Lett..

[3]  Vivek Bannore,et al.  Fast Iterative Super-Resolution for Image Sequences , 2007, 9th Biennial Conference of the Australian Pattern Recognition Society on Digital Image Computing Techniques and Applications (DICTA 2007).

[4]  Liang Zhou,et al.  A Robust Resolution-Enhancement Scheme for Video Transmission Over Mobile Ad-Hoc Networks , 2008, IEEE Transactions on Broadcasting.

[5]  Michael Elad,et al.  Advances and challenges in super‐resolution , 2004, Int. J. Imaging Syst. Technol..

[6]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[7]  Chun-Ming Lai,et al.  News Video Summarization Based on Spatial and Motion Feature Analysis , 2004, PCM.

[8]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[9]  Sebastián López,et al.  Low-Cost Super-Resolution Algorithms Implementation Over a HW/SW Video Compression Platform , 2006, EURASIP J. Adv. Signal Process..

[10]  Yao Wang,et al.  Video Processing and Communications , 2001 .

[11]  Lisimachos P. Kondi,et al.  An image super-resolution algorithm for different error levels per frame , 2006, IEEE Transactions on Image Processing.

[12]  Wen-Yu Su,et al.  Recursive high-resolution reconstruction of blurred multiframe images , 1993, IEEE Trans. Image Process..

[13]  Michael Elad,et al.  A fast super-resolution reconstruction algorithm for pure translational motion and common space-invariant blur , 2001, IEEE Trans. Image Process..

[14]  S. Chaudhuri,et al.  High-resolution slow-motion sequencing: how to generate a slow-motion sequence from a bit stream , 2005, IEEE Signal Processing Magazine.

[15]  Ming-Hwa Sheu,et al.  Directional interpolation for field-sequential stereoscopic video , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[16]  Chin-Teng Lin,et al.  An HVS-Directed Neural-Network-Based Image Resolution Enhancement Scheme for Image Resizing , 2007, IEEE Transactions on Fuzzy Systems.

[17]  José Carlos Príncipe,et al.  Super-resolution of images based on local correlations , 1999, IEEE Trans. Neural Networks.

[18]  Il-hong Shin,et al.  Image Resolution Enhancement using Inter-Subband Correlation in Wavelet Domain , 2007, 2007 IEEE International Conference on Image Processing.

[19]  Russell M. Mersereau,et al.  A new method for directional image interpolation , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[20]  Díbio Leandro Borges,et al.  A locally adaptive edge-preserving algorithm for image interpolation , 2002, Proceedings. XV Brazilian Symposium on Computer Graphics and Image Processing.

[21]  Alwyn Roshan Pais,et al.  Generation of Super-Resolution Video from Low Resolution Video Sequences: A Novel Approach , 2007, International Conference on Computational Intelligence and Multimedia Applications (ICCIMA 2007).

[22]  Seung P. Kim,et al.  High‐resolution restoration of dynamic image sequences , 1994, Int. J. Imaging Syst. Technol..

[23]  Russell C. Hardie,et al.  A Fast Image Super-Resolution Algorithm Using an Adaptive Wiener Filter , 2007, IEEE Transactions on Image Processing.

[24]  Wilson S. Geisler,et al.  Image quality assessment based on a degradation model , 2000, IEEE Trans. Image Process..

[25]  Jan P. Allebach,et al.  Tree-Based Resolution Synthesis , 1999, PICS.

[26]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[27]  Robert L. Stevenson,et al.  Super-resolution from image sequences-a review , 1998, 1998 Midwest Symposium on Circuits and Systems (Cat. No. 98CB36268).

[28]  Nirmal K. Bose,et al.  Recursive implementation of total least squares algorithm for image reconstruction from noisy, undersampled multiframes , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[29]  Mei-Juan Chen,et al.  A fast edge-oriented algorithm for image interpolation , 2005, Image Vis. Comput..

[30]  Jin-Jang Leou,et al.  An adaptive image interpolation algorithm for image/video processing , 2001, Pattern Recognit..

[31]  Xiangzhong Fang,et al.  Multiframe Super-Resolution Reconstruction Based on Cycle-Spinning , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[32]  Alptekin Temizel,et al.  Wavelet domain image resolution enhancement , 2006 .

[33]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[34]  Roger Y. Tsai,et al.  Multiframe image restoration and registration , 1984 .

[35]  Terrance E. Boult,et al.  Efficient super-resolution via image warping , 2000, Image Vis. Comput..

[36]  Subhasis Chaudhuri,et al.  High-Resolution Slow-Motion Sequencing , 2005 .

[37]  Daniel Gross,et al.  Improved resolution from subpixel shifted pictures , 1992, CVGIP Graph. Model. Image Process..