High-resolution image reconstruction from a sequence of rotated and translated infrared images

Some imaging systems employ detector arrays which are not sufficiently dense so as to meet the Nyquist criteria during image acquisition. This is particularly true for many staring infrared images. Thus, the full resolution afforded by the optics is not being realized in such a system. This paper presents a technique for estimating a high resolution image, with reduced aliasing, from a sequence of undersampled rotated and translationally shifted frames. Such an image sequence can be obtained if an imager is mounted on a moving platform, such as an aircraft. Several approaches to this type of problem have been proposed in the literature. Here we extend some of this previous work. In particular, we define an observation model which incorporates knowledge of the optical system and detector array. The high resolution image estimate is formed by minimizing a regularized cost function which is based on the observation model. We consider both gradient descent and conjugate gradient optimization procedures to minimize the cost function. We show that the conjugate gradient optimization provides rapid convergence. Detailed experimental results are provided to illustrate the performance of the proposed algorithm using both visible and infrared images. Quantitative error analysis is provided and several images are shown for subjective evaluation.

[1]  Nirmal K. Bose,et al.  Recursive reconstruction of high resolution image from noisy undersampled multiframes , 1990, IEEE Trans. Acoust. Speech Signal Process..

[2]  R. Hardie,et al.  Reduction of aliasing in staring infrared imagers utilizing subpixel techniques , 1995, Proceedings of the IEEE 1995 National Aerospace and Electronics Conference. NAECON 1995.

[3]  A. Murat Tekalp,et al.  High-resolution image reconstruction from a low-resolution image sequence in the presence of time-varying motion blur , 1992, Proceedings of 1st International Conference on Image Processing.

[4]  Reginald L. Lagendijk,et al.  Regularized iterative image restoration with ringing reduction , 1988, IEEE Trans. Acoust. Speech Signal Process..

[5]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[6]  Russell C. Hardie,et al.  Joint MAP registration and high-resolution image estimation using a sequence of undersampled images , 1997, IEEE Trans. Image Process..

[7]  Roger Y. Tsai,et al.  Multiframe image restoration and registration , 1984 .

[8]  Robert L. Stevenson,et al.  Extraction of high-resolution frames from video sequences , 1996, IEEE Trans. Image Process..

[9]  H Stark,et al.  High-resolution image recovery from image-plane arrays, using convex projections. , 1989, Journal of the Optical Society of America. A, Optics and image science.

[10]  Peter Cheeseman,et al.  Super-Resolved Surface Reconstruction from Multiple Images , 1996 .

[11]  Mostafa Kaveh,et al.  A regularization approach to joint blur identification and image restoration , 1996, IEEE Trans. Image Process..