Digital superresolution and the generalized sampling theorem.

The technique of reconstructing a higher-resolution (HR) image of size MLxML by digitally processing LxL subpixel-shifted lower-resolution (LR) copies of it, each of size MxM, has now become well established. This particular digital superresolution problem is analyzed from the standpoint of the generalized sampling theorem. It is shown both theoretically and by computer simulation that the choice of regularly spaced subpixel shifts for the LR images tends to maximize the robustness and minimize the error of reconstruction of the HR image. In practice, since subpixel-level control of LR image shifts may be nearly impossible to achieve, however, a more likely scenario, which is also discussed, is one involving random subpixel shifts. It is shown that without reasonably tight bounds on the range of random shifts, the reconstruction is likely to fail in the presence of even small amounts of noise unless either reliable prior information or additional data are available.

[1]  Robert L. Stevenson,et al.  Extraction of high-resolution frames from video sequences , 1996, IEEE Trans. Image Process..

[2]  Michael Elad,et al.  A fast super-resolution reconstruction algorithm for pure translational motion and common space-invariant blur , 2001, IEEE Trans. Image Process..

[3]  A. Papoulis,et al.  Generalized sampling expansion , 1977 .

[4]  Nirmal K. Bose,et al.  Recursive reconstruction of high resolution image from noisy undersampled multiframes , 1990, IEEE Trans. Acoust. Speech Signal Process..

[5]  Michael Elad,et al.  Advances and challenges in super‐resolution , 2004, Int. J. Imaging Syst. Technol..

[6]  L. Poletto,et al.  Enhancing the spatial resolution of a two-dimensional discrete array detector , 1999 .

[7]  David J. Brady,et al.  Compressive Optical MONTAGE Photography Initiative: Noise and Error Analysis , 2005 .

[8]  Deepu Rajan,et al.  Simultaneous Estimation of Super-Resolved Scene and Depth Map from Low Resolution Defocused Observations , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Michael Elad,et al.  Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images , 1997, IEEE Trans. Image Process..

[10]  Jun Tanida,et al.  Reconstruction of a high-resolution image on a compound-eye image-capturing system. , 2004, Applied optics.

[11]  Peyman Milanfar,et al.  Statistical performance analysis of super-resolution , 2006, IEEE Transactions on Image Processing.

[12]  J. Tanida,et al.  Thin Observation Module by Bound Optics (TOMBO): Concept and Experimental Verification. , 2001, Applied optics.

[13]  Daniel Gross,et al.  Improved resolution from subpixel shifted pictures , 1992, CVGIP Graph. Model. Image Process..

[14]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[15]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[16]  Russell C. Hardie,et al.  Joint MAP registration and high-resolution image estimation using a sequence of undersampled images , 1997, IEEE Trans. Image Process..

[17]  R. Barnard,et al.  High-resolution iris image reconstruction from low-resolution imagery , 2006, SPIE Optics + Photonics.

[18]  Roger Y. Tsai,et al.  Multiframe image restoration and registration , 1984 .