Use of multiresolution wavelet feature pyramids for automatic registration of multisensor imagery

The problem of image registration, or the alignment of two or more images representing the same scene or object, has to be addressed in various disciplines that employ digital imaging. In the area of remote sensing, just like in medical imaging or computer vision, it is necessary to design robust, fast, and widely applicable algorithms that would allow automatic registration of images generated by various imaging platforms at the same or different times and that would provide subpixel accuracy. One of the main issues that needs to be addressed when developing a registration algorithm is what type of information should be extracted from the images being registered, to be used in the search for the geometric transformation that best aligns them. The main objective of this paper is to evaluate several wavelet pyramids that may be used both for invariant feature extraction and for representing images at multiple spatial resolutions to accelerate registration. We find that the bandpass wavelets obtained from the steerable pyramid due to Simoncelli performs best in terms of accuracy and consistency, while the low-pass wavelets obtained from the same pyramid give the best results in terms of the radius of convergence. Based on these findings, we propose a modification of a gradient-based registration algorithm that has recently been developed for medical data. We test the modified algorithm on several sets of real and synthetic satellite imagery.

[1]  I. J. Schoenberg,et al.  Cardinal interpolation and spline functions , 1969 .

[2]  Jacqueline Le Moigne,et al.  Iterative Pyramid-Based Approach to Subpixel Registration of Multisensor Satellite Imagery , 2002, SPIE Optics + Photonics.

[3]  Michael Unser,et al.  Optimization of mutual information for multiresolution image registration , 2000, IEEE Trans. Image Process..

[4]  Jan Flusser,et al.  An adaptive method for image registration , 1992, Pattern Recognit..

[5]  Zheng Liu,et al.  Using multiple orientational filters of steerable pyramid for image registration , 2002, Inf. Fusion.

[6]  Roger D Eastman,et al.  Gradient Descent Techniques for Multitemporal and Multi-Sensor Image Registration of Remotely Sensed Imagery , 2001 .

[7]  A. Bijaoui,et al.  Geometrical registration of images: the multiresolution approach , 1993 .

[8]  Hassan Foroosh,et al.  Extension of phase correlation to subpixel registration , 2002, IEEE Trans. Image Process..

[9]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[10]  A. Ardeshir Goshtasby,et al.  Registration of images with geometric distortions , 1988 .

[11]  Edward H. Adelson,et al.  Shiftable multiscale transforms , 1992, IEEE Trans. Inf. Theory.

[12]  J. Le Moigne,et al.  First evaluation of automatic image registration methods , 1998, IGARSS '98. Sensing and Managing the Environment. 1998 IEEE International Geoscience and Remote Sensing. Symposium Proceedings. (Cat. No.98CH36174).

[13]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[14]  Anil K. Jain,et al.  Registering Landsat images by point matching , 1989 .

[15]  J. L. Moigne Parallel registration of multisensor remotely sensed imagery using wavelet coefficients , 1994 .

[16]  Julian Magarey,et al.  Motion estimation using a complex-valued wavelet transform , 1998, IEEE Trans. Signal Process..

[17]  George C. Stockman,et al.  Matching Images to Models for Registration and Object Detection via Clustering , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Tarek El-Ghazawi,et al.  Towards an intercomparison of automated registration algorithms for multiple source remote sensing data , 1997 .

[19]  Michael Unser,et al.  A pyramid approach to subpixel registration based on intensity , 1998, IEEE Trans. Image Process..

[20]  George Wolberg,et al.  Digital image warping , 1990 .

[21]  Michel Defrise,et al.  Symmetric Phase-Only Matched Filtering of Fourier-Mellin Transforms for Image Registration and Recognition , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[23]  Rama Chellappa,et al.  A computational vision approach to image registration , 1993, IEEE Trans. Image Process..

[24]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[25]  David M. Mount,et al.  Efficient algorithms for robust feature matching , 1999, Pattern Recognit..

[26]  Jacqueline Le Moigne,et al.  An automated parallel image registration technique based on the correlation of wavelet features , 2013, IEEE Trans. Geosci. Remote. Sens..

[27]  Jacqueline Le Moigne,et al.  The Translation Sensitivity of Wavelet-Based Registration , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  C. Justice,et al.  A framework for the validation of MODIS Land products , 2002 .

[29]  Ernest M. Stokely,et al.  Laplacian and orthogonal wavelet pyramid decompositions in coarse-to-fine registration , 1993, IEEE Trans. Signal Process..

[30]  Rama Chellappa,et al.  A new approach to image feature detection with applications , 1996, Pattern Recognit..

[31]  D. Donoho,et al.  Translation-Invariant De-Noising , 1995 .

[32]  J. Dorband,et al.  Hubble Space Telescope Faint Object Camera calculated point-spread functions. , 1997, Applied optics.

[33]  Jacqueline Le Moigne,et al.  Application of rotation- and translation-invariant overcomplete wavelets to the registration of remotely sensed imagery , 1999, Defense, Security, and Sensing.

[34]  Michael T. Orchard,et al.  A fast direct Fourier-based algorithm for subpixel registration of images , 2001, IEEE Trans. Geosci. Remote. Sens..

[35]  Michael Unser,et al.  Multiresolution image registration procedure using spline pyramids , 1993, Optics & Photonics.

[36]  Michael Unser,et al.  The L2-Polynomial Spline Pyramid , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[38]  Jacqueline Le Moigne,et al.  Evaluating performance of automatic techniques for subpixel registration of remotely sensed imagery , 2003, IS&T/SPIE Electronic Imaging.