Registration of aliased images for super-resolution imaging

Super-resolution imaging techniques reconstruct a high resolution image from a set of low resolution images that are taken from almost the same point of view. The problem can be subdivided into two main parts: an image registration part where the different input images are aligned with each other, and a reconstruction part, where the high resolution image is reconstructed from the aligned images. In this paper, we mainly consider the first step: image registration. We present three frequency domain methods to accurately align a set of undersampled images. First, we describe a registration method for images that have an aliasing-free part in their spectrum. The images are then registered using that aliasing-free part. Next, we present two subspace methods to register completely aliased images. Arbitrary undersampling factors are possible with these methods, but they have an increased computational complexity. In all three methods, we only consider planar shifts. We also show the results of these three algorithms in simulations and practical experiments.

[1]  Andrew Zisserman,et al.  Computer vision applied to super resolution , 2003, IEEE Signal Process. Mag..

[2]  Nirmal K. Bose,et al.  Recursive reconstruction of high resolution image from noisy undersampled multiframes , 1990, IEEE Trans. Acoust. Speech Signal Process..

[3]  S. P. Kim,et al.  Subpixel accuracy image registration by spectrum cancellation , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[4]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[5]  Thomas Strohmer,et al.  Computationally attractive reconstruction of bandlimited images from irregular samples , 1997, IEEE Trans. Image Process..

[6]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[7]  Hassan Foroosh,et al.  Extension of phase correlation to subpixel registration , 2002, IEEE Trans. Image Process..

[8]  Robert L. Stevenson,et al.  Spatial Resolution Enhancement of Low-Resolution Image Sequences A Comprehensive Review with Directions for Future Research , 1998 .

[9]  Brendan McCane,et al.  Recovering Motion Fields: An Evaluation of Eight Optical Flow Algorithms , 1998, BMVC.

[10]  Joos Vandewalle,et al.  How to take advantage of aliasing in bandlimited signals , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[11]  Aggelos K. Katsaggelos,et al.  Resolution enhancement of monochrome and color video using motion compensation , 2001, IEEE Trans. Image Process..

[12]  Li Meng,et al.  Subpixel Motion Estimation for Super-Resolution Image Sequence Enhancement , 1998, J. Vis. Commun. Image Represent..

[13]  Roger Y. Tsai,et al.  Multiframe image restoration and registration , 1984 .

[14]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[15]  Sabine Süsstrunk,et al.  A Frequency Domain Approach to Registration of Aliased Images with Application to Super-resolution , 2006, EURASIP J. Adv. Signal Process..

[16]  Sabine Süsstrunk,et al.  Super-resolution from highly undersampled images , 2005, IEEE International Conference on Image Processing 2005.

[17]  Luca Lucchese,et al.  A noise-robust frequency domain technique for estimating planar roto-translations , 2000, IEEE Trans. Signal Process..

[18]  B. N. Chatterji,et al.  An FFT-based technique for translation, rotation, and scale-invariant image registration , 1996, IEEE Trans. Image Process..

[19]  B. Marcel,et al.  3 - Calcul de translation et rotation par la transformation de Fourier , 1997 .

[20]  A. Papoulis,et al.  Generalized sampling expansion , 1977 .

[21]  Shmuel Peleg,et al.  Image sequence enhancement using sub-pixel displacements , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Michael Elad,et al.  A fast super-resolution reconstruction algorithm for pure translational motion and common space-invariant blur , 2001, IEEE Trans. Image Process..

[23]  Michael T. Orchard,et al.  A fast direct Fourier-based algorithm for subpixel registration of images , 2001, IEEE Trans. Geosci. Remote. Sens..

[24]  A. Murat Tekalp,et al.  Superresolution video reconstruction with arbitrary sampling lattices and nonzero aperture time , 1997, IEEE Trans. Image Process..

[25]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[26]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[27]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..