Mathematical model development of super-resolution image Wiener restoration

In super-resolution (SR), a set of degraded low-resolution (LR) images are used to reconstruct a higher-resolution image that suffers from acquisition degradations. One way to boost SR images visual quality is to use restoration filters to remove reconstructed images artifacts. We propose an efficient method to optimally allocate the LR pixels on the high-resolution grid and introduce a mathematical derivation of a stochastic Wiener filter. It relies on the continuous-discrete-continuous model and is constrained by the periodic and nonperiodic interrelationships between the different frequency components of the proposed SR system. We analyze an end-to-end model and formulate the Wiener filter as a function of the parameters associated with the proposed SR system such as image gathering and display response indices, system average signal-to-noise ratio, and inter-subpixel shifts between the LR images. Simulation and experimental results demonstrate that the derived Wiener filter with the optimal allocation of LR images results in sharper reconstruction. When compared with other SR techniques, our approach outperforms them in both quality and computational time.

[1]  Y. Itakura,et al.  Statistical properties of the background noise for the atmospheric windows in the intermediate infrared region , 1974 .

[2]  F. O. Huck,et al.  Wiener restoration of sampled image data: end-to-end analysis , 1988 .

[3]  Shmuel Peleg,et al.  Robust super-resolution , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[4]  H Stark,et al.  High-resolution image recovery from image-plane arrays, using convex projections. , 1989, Journal of the Optical Society of America. A, Optics and image science.

[5]  Jiang Li,et al.  On the visual quality enhancement of super-resolution images , 2011, Optical Engineering + Applications.

[6]  Qi Tian,et al.  Algorithms for subpixel registration , 1986 .

[7]  Mohammad S. Alam,et al.  Infrared image registration and high-resolution reconstruction using multiple translationally shifted aliased video frames , 2000, IEEE Trans. Instrum. Meas..

[8]  Kiyoharu Aizawa,et al.  Signal-processing based method for acquiring very high resolution images with multiple cameras and its theoretical analysis , 1992 .

[9]  Michael Elad,et al.  Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images , 1997, IEEE Trans. Image Process..

[10]  Peyman Milanfar,et al.  A wavelet-based interpolation-restoration method for superresolution (wavelet superresolution) , 2000 .

[11]  Robert L. Stevenson,et al.  Spatial Resolution Enhancement of Low-Resolution Image Sequences A Comprehensive Review with Directions for Future Research , 1998 .

[12]  Michael Elad,et al.  Super-resolution reconstruction of an image , 1996, Proceedings of 19th Convention of Electrical and Electronics Engineers in Israel.

[13]  Wen-Yu Su,et al.  Recursive high-resolution reconstruction of blurred multiframe images , 1993, IEEE Trans. Image Process..

[14]  Nirmal K. Bose,et al.  Recursive reconstruction of high resolution image from noisy undersampled multiframes , 1990, IEEE Trans. Acoust. Speech Signal Process..

[15]  Peyman Milanfar,et al.  Efficient generalized cross-validation with applications to parametric image restoration and resolution enhancement , 2001, IEEE Trans. Image Process..

[16]  Daniel Gross,et al.  Improved resolution from subpixel shifted pictures , 1992, CVGIP Graph. Model. Image Process..

[17]  Avideh Zakhor,et al.  Resolution enhancement of color video sequences , 1999, IEEE Trans. Image Process..

[18]  Zia-ur Rahman,et al.  On the restoration of the microscanned images captured from unmanned airborne vehicles , 2011, Defense + Commercial Sensing.

[19]  Michael K. Ng,et al.  Super-Resolution Image Restoration from Blurred Low-Resolution Images , 2005, Journal of Mathematical Imaging and Vision.

[20]  Manuel Guizar-Sicairos,et al.  Efficient subpixel image registration algorithms. , 2008, Optics letters.

[21]  Roger Y. Tsai,et al.  Multiframe image restoration and registration , 1984 .

[22]  Guna Seetharaman,et al.  Application Of Papoulis-Gerchberg Method In Image Super-Resolution and Inpainting , 2009, Comput. J..

[23]  Stephen E Reichenbach,et al.  Small-kernel superresolution methods for microscanning imaging systems. , 2006, Applied optics.

[24]  Peyman Milanfar,et al.  A computationally efficient superresolution image reconstruction algorithm , 2001, IEEE Trans. Image Process..

[25]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[26]  Jan P. Allebach,et al.  Iterative reconstruction of bandlimited images from nonuniformly spaced samples , 1987 .

[27]  A. Murat Tekalp,et al.  Superresolution video reconstruction with arbitrary sampling lattices and nonzero aperture time , 1997, IEEE Trans. Image Process..

[28]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[29]  Klamer Schutte,et al.  Robust Fusion of Irregularly Sampled Data Using Adaptive Normalized Convolution , 2006, EURASIP J. Adv. Signal Process..

[30]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[31]  Otto H. Schade Image Gradation, Graininess and Sharpness in Television and Motion Picture Systems: Part I: Image Structure and Transfer Characteristics , 1951 .