Applications of super-resolution and deblurring to practical sensors

In image formation and recording process, there are many factors that affect sensor performance and image quality that result in loss of high-frequency information. Two of these common factors are undersampled sensors and sensor's blurring function. Two image processing algorithms, including super-resolution image reconstruction and deblur filtering, have been developed based on characterizing the sources of image degradation from image formation and recording process. In this paper, we discuss the applications of these two algorithms to three practical thermal imaging systems. First, super-resolution and deblurring are applied to a longwave uncooled sensor in a missile seeker. Target resolution is improved in the flight phase of the seeker operation. Second, these two algorithms are applied to a midwave target acquisition sensor for use in long-range target identification. Third, the two algorithms are applied to a naval midwave distributed aperture sensor (DAS) for infrared search and track (IRST) system that is dual use in missile detection and force protection/anti-terrorism applications. In this case, super-resolution and deblurring are used to improve the resolution of on-deck activity discrimination.

[1]  P. H. Cittert Zum Einfluß der Spaltbreite auf die Intensitätsverteilung in Spektrallinien. II , 1930 .

[2]  Michael T. Orchard,et al.  A fast direct Fourier-based algorithm for subpixel registration of images , 2001, IEEE Trans. Geosci. Remote. Sens..

[3]  P. E. Anuta,et al.  Spatial Registration of Multispectral and Multitemporal Digital Imagery Using Fast Fourier Transform Techniques , 1970 .

[4]  Brandoch Calef,et al.  Regularization for non-linear image restoration using a prior on the object power spectrum , 2005, SPIE Optics + Photonics.

[5]  Hassan Foroosh,et al.  Extension of phase correlation to subpixel registration , 2002, IEEE Trans. Image Process..

[6]  B. Roy Frieden,et al.  A `CLEAN'-type Deconvolution Algorithm , 1978 .

[7]  Ronald G. Driggers,et al.  Dynamic sampling, resolution enhancement, and super resolution , 2000 .

[8]  Thomas S. Huang Image enhancement and restoration , 1986 .

[9]  Aggelos K. Katsaggelos,et al.  Approximations of posterior distributions in blind deconvolution using variational methods , 2005, IEEE International Conference on Image Processing 2005.

[10]  A. Schaum,et al.  Analytic Methods of Image Registration: Displacement Estimation and Resampling , 1991 .

[11]  A. Murat Tekalp,et al.  Maximum likelihood image and blur identification: a unifying , 1990 .

[12]  Peter Seitz,et al.  Optical Superresolution Using Solid-State Cameras And Digita; Signal Processing , 1988 .

[13]  Eddie L Jacobs,et al.  Adaptive deblurring of noisy images. , 2007, Applied optics.

[14]  Zeev Zalevsky,et al.  Geometrical superresolution in infrared sensor: experimental verification , 2004 .

[15]  Carl E. Halford,et al.  Performance comparison of rectangular (4-point) and diagonal (2-point) dither , 2000, Defense, Security, and Sensing.

[16]  N S Kopeika,et al.  General restoration filter for vibrated image restoration , 1997, Optics & Photonics.

[17]  Robert de Levie On deconvolving spectra , 2004 .

[18]  Ikram E. Abdou,et al.  Practical approach to the registration of multiple frames of video images , 1998, Electronic Imaging.

[19]  Robert L. Stevenson,et al.  Super-resolution from image sequences-a review , 1998, 1998 Midwest Symposium on Circuits and Systems (Cat. No. 98CB36268).

[20]  Deepa Kundur,et al.  Blind Image Deconvolution , 2001 .

[21]  B. R. Frieden Image enhancement and restoration , 1979 .

[22]  S. Susan Young,et al.  Super-resolution image reconstruction from a sequence of aliased imagery , 2005, SPIE Defense + Commercial Sensing.

[23]  Guy Demoment,et al.  Image reconstruction and restoration: overview of common estimation structures and problems , 1989, IEEE Trans. Acoust. Speech Signal Process..

[24]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[25]  S. Susan Young Alias-free image subsampling using Fourier-based windowing methods , 2004 .

[26]  Qi Tian,et al.  Algorithms for subpixel registration , 1986 .

[27]  M. Ibrahim Sezan,et al.  Tutorial review of recent developments in digital image restoration , 1990, Other Conferences.

[28]  Edmund Y Lam Digital restoration of defocused images in the wavelet domain. , 2002, Applied optics.

[29]  Shree K. Nayar,et al.  Video super-resolution using controlled subpixel detector shifts , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.