Regularized high-resolution image reconstruction considering inaccurate motion information

One of the major issues in recovering a high-resolution image from a sequence of low-resolution observations is the accuracy of the motion information. In most of the work in the literature, the motion information is assumed to be known with high accuracy. This is very often not the case, and therefore the accuracy of high-resolution image reconstruction suffers substantially, since it greatly depends on the motion information. To address these issues in this paper, we propose a high-resolution image reconstruction algorithm that reduces the distortion in the reconstructed high-resolution image due to the inaccuracy of the estimated motion. Towards this task, we analyze the reconstruction noise generated by the inaccurate motion information. Based on this analysis, we propose a new regularization functional and derive a sufficient condition for the convergence of the resulting iterative reconstruction algorithm. The proposed algorithm requires no prior information about the original image or the inaccuracy of the motion information. Experimental results illustrate the benefit of the proposed method when compared to conventional high-resolution image reconstruction methods in terms of both objective measurements and subjective evaluation.

[1]  Wen-Yu Su,et al.  Recursive high-resolution reconstruction of blurred multiframe images , 1993, IEEE Trans. Image Process..

[2]  Nirmal K. Bose,et al.  Recursive reconstruction of high resolution image from noisy undersampled multiframes , 1990, IEEE Trans. Acoust. Speech Signal Process..

[3]  H Stark,et al.  High-resolution image recovery from image-plane arrays, using convex projections. , 1989, Journal of the Optical Society of America. A, Optics and image science.

[4]  A. Murat Tekalp,et al.  Superresolution video reconstruction with arbitrary sampling lattices and nonzero aperture time , 1997, IEEE Trans. Image Process..

[5]  Robert L. Stevenson,et al.  Extraction of high-resolution frames from video sequences , 1996, IEEE Trans. Image Process..

[6]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[7]  Aggelos K. Katsaggelos,et al.  General choice of the regularization functional in regularized image restoration , 1995, IEEE Trans. Image Process..

[8]  N.K. Bose,et al.  Performance analysis of the TLS algorithm for image reconstruction from a sequence of undersampled noisy and blurred frames , 1994, Proceedings of 1st International Conference on Image Processing.

[9]  Moon Gi Kang,et al.  Spatially adaptive regularized iterative high-resolution image reconstruction algorithm , 2000, IS&T/SPIE Electronic Imaging.

[10]  Edward A. Watson,et al.  High-Resolution Image Reconstruction from a Sequence of Rotated and Translated Frames and its Application to an Infrared Imaging System , 1998 .

[11]  Daniel Gross,et al.  Improved resolution from subpixel shifted pictures , 1992, CVGIP Graph. Model. Image Process..

[12]  Carlos Vázquez,et al.  Reconstruction of nonuniformly sampled images in spline spaces , 2005, IEEE Transactions on Image Processing.

[13]  M. Ng,et al.  Analysis of displacement errors in high-resolution image reconstruction with multisensors , 2002 .

[14]  Aggelos K. Katsaggelos,et al.  Parameter estimation in Bayesian high-resolution image reconstruction with multisensors , 2003, IEEE Trans. Image Process..

[15]  Michael Elad,et al.  Superresolution restoration of an image sequence: adaptive filtering approach , 1999, IEEE Trans. Image Process..

[16]  Moon Gi Kang,et al.  Regularized adaptive high-resolution image reconstruction considering inaccurate subpixel registration , 2003, IEEE Trans. Image Process..

[17]  Thomas S. Huang,et al.  Image processing , 1971 .

[18]  Russell C. Hardie,et al.  Joint MAP registration and high-resolution image estimation using a sequence of undersampled images , 1997, IEEE Trans. Image Process..

[19]  B. R. Hunt,et al.  The Application of Constrained Least Squares Estimation to Image Restoration by Digital Computer , 1973, IEEE Transactions on Computers.

[20]  Aggelos K. Katsaggelos,et al.  Simultaneous multichannel image restoration and estimation of the regularization parameters , 1997, IEEE Trans. Image Process..