Subspace-based methods for image registration and super-resolution

Super-resolution algorithms combine multiple low resolution images into a single high resolution image. They have received a lot of attention recently in various application domains such as HDTV, satellite imaging, and video surveillance. These techniques take advantage of the aliasing present in the input images to reconstruct high frequency information of the resulting image. One of the major challenges in such algorithms is a good alignment of the input images: subpixel precision is required to enable accurate reconstruction. In this paper, we give an overview of some subspace techniques that address this problem. We first formulate super-resolution in a multichannel sampling framework with unknown offsets. Then, we present three registration methods: one approach using ideas from variable projections, one using a Fourier description of the aliased signals, and one using a spline description of the sampling kernel. The performance of the algorithms is evaluated in numerical simulations.

[1]  Pier Luigi Dragotti,et al.  Distributed Acquisition and Image Super-Resolution Based on Continuous Moments from Samples , 2006, 2006 International Conference on Image Processing.

[2]  P. Vandewalle Super-resolution from unregistered aliased images , 2006 .

[3]  PROCEssIng magazInE IEEE Signal Processing Magazine , 2004 .

[4]  Pier Luigi Dragotti,et al.  Local Feature Extraction for Image Super-Resolution , 2007, 2007 IEEE International Conference on Image Processing.

[5]  Axel Ruhe,et al.  Algorithms for separable nonlinear least squares problems , 1980 .

[6]  Joos Vandewalle,et al.  Super-Resolution From Unregistered and Totally Aliased Signals Using Subspace Methods , 2007, IEEE Transactions on Signal Processing.

[7]  Q PhamTuan,et al.  Robust fusion of irregularly sampled data using adaptive normalized convolution , 2006 .

[8]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[9]  Roger Y. Tsai,et al.  Multiframe image restoration and registration , 1984 .

[10]  Li Chen,et al.  Joint Image Registration and Super-Resolution using Nonlinear Least Squares Method , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[11]  Søren Holdt Jensen,et al.  EURASIP Journal on Applied Signal Processing , 2005 .

[12]  J. Nagy,et al.  Enforcing nonnegativity in image reconstruction algorithms , 2000, SPIE Optics + Photonics.

[13]  Peyman Milanfar,et al.  Optimal Registration Of Aliased Images Using Variable Projection With Applications To Super-Resolution , 2008, Comput. J..