Optimal Registration Of Aliased Images Using Variable Projection With Applications To Super-Resolution

Accurate registration of images is the most important and challenging aspect of multiframe image restoration problems such as super-resolution. The accuracy of super-resolution algorithms is quite often limited by the ability to register a set of low-resolution images. The main challenge in registering such images is the presence of aliasing. In this paper, we analyse the problem of jointly registering a set of aliased images and its relationship to super-resolution. We describe a statistically optimal approach to multiframe registration which exploits the concept of variable projections to achieve very efficient algorithms. Finally, we demonstrate how the proposed algorithm offers accurate estimation under various conditions when standard approaches fail to provide sufficient accuracy for super-resolution.

[1]  Roger Y. Tsai,et al.  Multiframe image restoration and registration , 1984 .

[2]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[3]  S. Farsiu,et al.  Constrained, globally optimal, multi-frame motion estimation , 2005, IEEE/SP 13th Workshop on Statistical Signal Processing, 2005.

[4]  Aggelos K. Katsaggelos,et al.  Resolution enhancement of monochrome and color video using motion compensation , 2001, IEEE Trans. Image Process..

[5]  Venu Madhav Govindu,et al.  Lie-algebraic averaging for globally consistent motion estimation , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[6]  Michael Elad,et al.  A fast super-resolution reconstruction algorithm for pure translational motion and common space-invariant blur , 2001, IEEE Trans. Image Process..

[7]  Michael Elad,et al.  Fast and Robust Multi-Frame Super-Resolution , 2004, IEEE Transactions on Image Processing.

[8]  J. Greivenkamp.  Color dependent optical prefilter for the suppression of aliasing artifacts. , 1990, Applied optics.

[9]  J. Nagy,et al.  Numerical methods for coupled super-resolution , 2006 .

[10]  Michael T. Orchard,et al.  A fast direct Fourier-based algorithm for subpixel registration of images , 2001, IEEE Trans. Geosci. Remote. Sens..

[11]  G. Golub,et al.  Separable nonlinear least squares: the variable projection method and its applications , 2003 .

[12]  Peyman Milanfar,et al.  Statistical performance analysis of super-resolution , 2006, IEEE Transactions on Image Processing.

[13]  Nirmal K. Bose,et al.  Recursive reconstruction of high resolution image from noisy undersampled multiframes , 1990, IEEE Trans. Acoust. Speech Signal Process..

[14]  Joos Vandewalle,et al.  How to take advantage of aliasing in bandlimited signals , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[15]  Hassan Foroosh,et al.  Extension of phase correlation to subpixel registration , 2002, IEEE Trans. Image Process..

[16]  S. Chaudhuri,et al.  Motion-Free Super-Resolution , 2005 .

[17]  Ambasamudram N Rajagopalan,et al.  Motion-free superresolution and the role of relative blur. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[18]  Peyman Milanfar,et al.  Robust Kernel Regression for Restoration and Reconstruction of Images from Sparse Noisy Data , 2006, 2006 International Conference on Image Processing.

[19]  Yaser Sheikh,et al.  AN ACCUMULATIVE FRAMEWORK FOR THE ALIGNMENT OF AN IMAGE SEQUENCE , 2003 .

[20]  Robert L. Stevenson,et al.  Super-resolution from image sequences-a review , 1998, 1998 Midwest Symposium on Circuits and Systems (Cat. No. 98CB36268).

[21]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[22]  D. Marquardt.  An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[23]  J. Goodman.  Introduction to Fourier optics , 1969 .

[24]  Nikolas P. Galatsanos,et al.  Stochastic methods for joint registration, restoration, and interpolation of multiple undersampled images , 2006, IEEE Transactions on Image Processing.

[25]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[26]  Harpreet S. Sawhney,et al.  Robust Video Mosaicing through Topology Inference and Local to Global Alignment , 1998, ECCV.

[27]  Nikolas P. Galatsanos,et al.  Reconstruction of a high resolution image from registration and restoration of low resolution images , 1994, Proceedings of 1st International Conference on Image Processing.

[28]  S. Kay.  Fundamentals of statistical signal processing: estimation theory , 1993 .

[29]  Marcel Worring,et al.  Dense motion estimation using regularization constraints on local parametric models , 2004, IEEE Transactions on Image Processing.

[30]  Michael Elad,et al.  Advances and challenges in super‐resolution , 2004, Int. J. Imaging Syst. Technol..

[31]  Russell C. Hardie,et al.  Joint MAP registration and high-resolution image estimation using a sequence of undersampled images , 1997, IEEE Trans. Image Process..

[32]  A. N. Rajagopalan,et al.  Motion-Free Superresolution , 2002, ICVGIP.

[33]  Boaz Porat,et al.  A course in digital signal processing , 1996 .

[34]  Sabine Süsstrunk,et al.  A Frequency Domain Approach to Registration of Aliased Images with Application to Super-resolution , 2006, EURASIP J. Adv. Signal Process..