Multiresolution registration of remote sensing imagery by optimization of mutual information using a stochastic gradient

Image registration is the process by which we determine a transformation that provides the most accurate match between two images. The search for the matching transformation can be automated with the use of a suitable metric, but it can be very time-consuming and tedious. We introduce a registration algorithm that combines a simple yet powerful search strategy based on a stochastic gradient with two similarity measures, correlation and mutual information, together with a wavelet-based multiresolution pyramid. We limit our study to pairs of images, which are misaligned by rotation and/or translation, and present two main results. First, we demonstrate that, in our application, mutual information may be better suited for sub-pixel registration as it produces consistently sharper optimum peaks than correlation. Then, we show that the stochastic gradient search combined with either measure produces accurate results when applied to synthetic data, as well as to multitemporal or multisensor collections of satellite data. Mutual information is generally found to optimize with one-third the number of iterations required by correlation. Results also show that a multiresolution implementation of the algorithm yields significant improvements in terms of both speed and robustness over a single-resolution implementation.

[1]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[2]  Michael Unser,et al.  A pyramid approach to subpixel registration based on intensity , 1998, IEEE Trans. Image Process..

[3]  Jacqueline Le Moigne,et al.  Mutual information as a similarity measure for remote sensing image registration , 2001, SPIE Defense + Commercial Sensing.

[4]  Jacqueline Le Moigne,et al.  Multiresolution registration of remote sensing images using stochastic gradient , 2002, SPIE Defense + Commercial Sensing.

[5]  Edward H. Adelson,et al.  Shiftable multiscale transforms , 1992, IEEE Trans. Inf. Theory.

[6]  Guy Marchal,et al.  Multi-modality image registration by maximization of mutual information , 1996, Proceedings of the Workshop on Mathematical Methods in Biomedical Image Analysis.

[7]  Jacqueline Le Moigne,et al.  The Translation Sensitivity of Wavelet-Based Registration , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Tim Hesterberg,et al.  Introduction to Stochastic Search and Optimization: Estimation, Simulation, and Control , 2004, Technometrics.

[9]  James C. Spall,et al.  Introduction to stochastic search and optimization - estimation, simulation, and control , 2003, Wiley-Interscience series in discrete mathematics and optimization.

[10]  Jacqueline Le Moigne,et al.  An automated parallel image registration technique based on the correlation of wavelet features , 2013, IEEE Trans. Geosci. Remote. Sens..

[11]  Carlos S. Kubrusly,et al.  Stochastic approximation algorithms and applications , 1973, CDC 1973.

[12]  J. Spall Multivariate stochastic approximation using a simultaneous perturbation gradient approximation , 1992 .

[13]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[14]  Paul A. Viola,et al.  Multi-modal volume registration by maximization of mutual information , 1996, Medical Image Anal..

[15]  Roger D Eastman,et al.  Gradient Descent Techniques for Multitemporal and Multi-Sensor Image Registration of Remotely Sensed Imagery , 2001 .

[16]  E. Dubois,et al.  Digital picture processing , 1985, Proceedings of the IEEE.

[17]  Michael Unser,et al.  Optimization of mutual information for multiresolution image registration , 2000, IEEE Trans. Image Process..

[18]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[19]  William K. Pratt,et al.  Correlation Techniques of Image Registration , 1974, IEEE Transactions on Aerospace and Electronic Systems.

[20]  Paul Suetens,et al.  Comparative evaluation of multiresolution optimization strategies for multimodality image registration by maximization of mutual information , 1999, Medical Image Anal..

[21]  Jacqueline Le Moigne,et al.  Iterative Pyramid-Based Approach to Subpixel Registration of Multisensor Satellite Imagery , 2002, SPIE Optics + Photonics.

[22]  Michael Unser,et al.  B-spline signal processing. I. Theory , 1993, IEEE Trans. Signal Process..

[23]  Akram Aldroubi,et al.  B-SPLINE SIGNAL PROCESSING: PART I-THEORY , 1993 .