Fast super-resolution with affine motion using an adaptive Wiener filter and its application to airborne imaging.

Fast nonuniform interpolation based super-resolution (SR) has traditionally been limited to applications with translational interframe motion. This is in part because such methods are based on an underlying assumption that the warping and blurring components in the observation model commute. For translational motion this is the case, but it is not true in general. This presents a problem for applications such as airborne imaging where translation may be insufficient. Here we present a new Fourier domain analysis to show that, for many image systems, an affine warping model with limited zoom and shear approximately commutes with the point spread function when diffraction effects are modeled. Based on this important result, we present a new fast adaptive Wiener filter (AWF) SR algorithm for non-translational motion and study its performance with affine motion. The fast AWF SR method employs a new smart observation window that allows us to precompute all the needed filter weights for any type of motion without sacrificing much of the full performance of the AWF. We evaluate the proposed algorithm using simulated data and real infrared airborne imagery that contains a thermal resolution target allowing for objective resolution analysis.

[1]  Russell C. Hardie,et al.  Aliasing reduction in staring infrared imagers utilizing subpixel techniques , 1995 .

[2]  R. Fiete Image quality and λFN/p for remote sensing systems , 1999 .

[3]  C. D. McGillem,et al.  Multitemporal Geometric Distortion Correction Utilizing the Affine Transformation , 1973 .

[4]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[5]  N. K. Bose,et al.  High resolution image formation from low resolution frames using Delaunay triangulation , 2002, IEEE Trans. Image Process..

[6]  Kenneth E. Barner,et al.  A Computationally Efficient Super-Resolution Algorithm for Video Processing Using Partition Filters , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Mohammad S. Alam,et al.  Infrared image registration and high-resolution reconstruction using multiple translationally shifted aliased video frames , 2000, IEEE Trans. Instrum. Meas..

[8]  David Capel,et al.  Image Mosaicing and Super-resolution , 2004, Distinguished Dissertations.

[9]  Frédéric Champagnat,et al.  An Improved Observation Model for Super-Resolution Under Affine Motion , 2006, IEEE Transactions on Image Processing.

[10]  Michael Elad,et al.  Fast and Robust Multi-Frame Super-Resolution , 2004, IEEE Transactions on Image Processing.

[11]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[12]  Russell C. Hardie,et al.  A Fast Image Super-Resolution Algorithm Using an Adaptive Wiener Filter , 2007, IEEE Transactions on Image Processing.

[13]  Edward A. Watson,et al.  High-Resolution Image Reconstruction from a Sequence of Rotated and Translated Frames and its Application to an Infrared Imaging System , 1998 .

[14]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[15]  R. Hardie,et al.  Reduction of aliasing in staring infrared imagers utilizing subpixel techniques , 1995, Proceedings of the IEEE 1995 National Aerospace and Electronics Conference. NAECON 1995.

[16]  Michael Elad,et al.  Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images , 1997, IEEE Trans. Image Process..

[17]  P. Anandan,et al.  Hierarchical Model-Based Motion Estimation , 1992, ECCV.