Achieving Accurate Image Registration as the Basis for Super-Resolution

Crucial information barely visible to the human eye is often embedded in a series of low-resolution images taken of the same scene. Super-resolution enables the extraction of this information by reconstructing a single image, at a higherresolution than is present in any of the individual images. This is particularly useful in forensic imaging, where the extraction of minute details in an image can help solve a crime. The capturing of multiple low-resolution images taken of the same scene results in a distortion between each image. Image registration is the process of determining this distortion. This information is then used in the super-resolution process to create a set of simulated low-resolution images. The differences between these simulated images and the observed images are then used to iteratively update an initial estimate of the high-resolution image. Successful superresolution is dependent on accurate image registration. In this thesis, we examine the hypothesis that the visual quality of a reconstructed high-resolution image improves when accurate image registration is achieved. In the first part of this thesis, we examine the image registration process in detail. Both picture and text images are registered using two algorithms. The first registration algorithm based on an optimization approach whilst the other is based on the RANSAC algorithm. We find that the optimization approach is severely hampered by higher degree transforms such as affine transforms. This is attributed to the increased number of parameters requiring optimizing. In the second part of this thesis, we focus on the super-resolution process. Numerous experiments were conducted to test our original hypothesis. The first experiment involved reconstructing an image when perfect registration was achieved, and comparing the results to when the RANSAC algorithm was employed. The results suggested that the visual quality of the reconstructed images were higher for perfect registration. We also found that the visual quality of reconstructed images was higher when images were registered using the RANSAC algorithm, as compared to an optimization approach.

[1]  Michal Irani,et al.  Motion Analysis for Image Enhancement: Resolution, Occlusion, and Transparency , 1993, J. Vis. Commun. Image Represent..

[2]  Robert C. Bolles,et al.  A RANSAC-Based Approach to Model Fitting and Its Application to Finding Cylinders in Range Data , 1981, IJCAI.

[3]  Its'hak Dinstein,et al.  Polyphase back-projection filtering for resolution enhancement of image sequences , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[4]  R. Sivaramakrishna,et al.  Image registration using minimization , 1995, IEEE WESCANEX 95. Communications, Power, and Computing. Conference Proceedings.

[5]  S. Gilles.  Description and experimentation of image matching using mutual information , 1996 .

[6]  Maurilio Marcacci,et al.  Interactive identification of marker position on 3D CT-based model , 1994, Proceedings of 16th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[7]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[8]  Rama Chellappa,et al.  A computational vision approach to image registration , 1993, IEEE Trans. Image Process..

[9]  G. M. Pagliari,et al.  Image registration, parameter tuning and approximate function evaluation, using the genetic algorithm and digital image warping , 1996, Proceedings of IEEE. AFRICON '96.

[10]  Michael T. Orchard,et al.  A fast direct Fourier-based algorithm for subpixel registration of images , 2001, IEEE Trans. Geosci. Remote. Sens..

[11]  Marco Corvi,et al.  Multiresolution image registration , 1995, Proceedings., International Conference on Image Processing.

[12]  Michael Unser,et al.  A pyramid approach to subpixel registration based on intensity , 1998, IEEE Trans. Image Process..

[13]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[14]  Andrew Zisserman,et al.  Super-resolution enhancement of text image sequences , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[15]  J. E. Glynn,et al.  Numerical Recipes: The Art of Scientific Computing , 1989 .

[16]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[17]  William H. Press,et al.  Numerical recipes in C. The art of scientific computing , 1987 .

[18]  Shmuel Peleg,et al.  Robust super-resolution , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.