Improving Piecewise Linear Registration of High-Resolution Satellite Images Through Mesh Optimization

Piecewise linear transformation is a powerful technique for coping with the registration of images affected by local geometric distortions, as it is usually the case of high-resolution satellite images. A key point when applying this technique is to divide the images to register according to a suitable common triangular mesh. This comprises two different aspects: where to place the mesh vertices (i.e., the mesh geometrical realization) and to set an appropriate topology upon these vertices (i.e., the mesh topological realization). This paper focuses on the latter and presents a novel method that improves the registration of two images by an iterative optimization process that modifies the mesh connectivity by swapping edges. For detecting if an edge needs to be swapped or not, we evaluate the registration improvement of that action on the two triangles connected by the edge. Another contribution of our proposal is the use of the mutual information for measuring the registration consistency within the optimization process, which provides more robustness to image changes than other well-known metrics such as normalized cross-correlation or sum of square differences. The proposed method has been successfully tested with different pairs of panchromatic QuickBird images (0.6 m/pixel of spatial resolution) of a variety of land covers (urban, residential, and rural) acquired under different lighting conditions and viewpoints.

[1]  Jordi Inglada,et al.  On the possibility of automatic multisensor image registration , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Kenichi Kanatani,et al.  Mesh optimization using an inconsistency detection template , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[3]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[4]  V. Arevalo,et al.  Automatic urban change detection from the IRS-1D PAN , 2001, IEEE/ISPRS Joint Workshop on Remote Sensing and Data Fusion over Urban Areas (Cat. No.01EX482).

[5]  Takeo Kanade,et al.  Image-consistent surface triangulation , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[6]  Gady Agam,et al.  Image-based view synthesis for enhanced perception in teleoperation , 2000, Defense, Security, and Sensing.

[7]  T. Davies,et al.  Bi-directional affine motion compensation using a content-based, non-connected, triangular mesh , 2004 .

[8]  Pramod K. Varshney,et al.  Performance of mutual information similarity measure for registration of multitemporal remote sensing images , 2003, IEEE Trans. Geosci. Remote. Sens..

[9]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[10]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[11]  Roberto Cipolla,et al.  Bayesian Stochastic Mesh Optimization for 3D reconstruction , 2003, BMVC.

[12]  Gang Xu,et al.  Epipolar Geometry in Stereo, Motion and Object Recognition , 1996, Computational Imaging and Vision.

[13]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[14]  Michael Unser,et al.  Fast parametric elastic image registration , 2003, IEEE Trans. Image Process..

[15]  Jacqueline Le Moigne,et al.  Multiresolution registration of remote sensing imagery by optimization of mutual information using a stochastic gradient , 2003, IEEE Trans. Image Process..

[16]  Dmitrij Schlesinger,et al.  A Higher Order MRF-Model for Stereo-Reconstruction , 2004, DAGM-Symposium.

[17]  S. Rippa,et al.  Data Dependent Triangulations for Piecewise Linear Interpolation , 1990 .

[18]  Bernd Hamann,et al.  Image Compression Using Data-Dependent Triangulations , 2007, ISVC.

[19]  Larry L. Schumaker,et al.  Cubic spline fitting using data dependent triangulations , 1990, Comput. Aided Geom. Des..

[20]  Larry L. Schumaker,et al.  Computing optimal triangulations using simulated annealing , 1993, Comput. Aided Geom. Des..

[21]  Gilbert Strang,et al.  Introduction to applied mathematics , 1988 .

[22]  Frans Vos,et al.  Accurate and High Quality Triangle Models from 3D Grey Scale Images , 2002, MICCAI.

[23]  Vicente Arévalo,et al.  An experimental evaluation of non‐rigid registration techniques on Quickbird satellite imagery , 2008 .

[24]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  A. Ardeshir Goshtasby,et al.  Piecewise cubic mapping functions for image registration , 1987, Pattern Recognit..

[26]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[27]  Marios S. Pattichis,et al.  Robust Multispectral Image Registration Using Mutual-Information Models , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[29]  Jesse S. Jin,et al.  Image Registration Using Triangular Mesh , 2004, PCM.

[30]  Fawwaz T. Ulaby,et al.  Mutual information based registration of SAR images , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[31]  Tony DeRose,et al.  Mesh optimization , 1993, SIGGRAPH.

[32]  Manfred Ehlers,et al.  High-precision geometric correction of airborne remote sensing revisited: the multiquadric interpolation , 1994, Remote Sensing.

[33]  A. Ardeshir Goshtasby,et al.  Piecewise linear mapping functions for image registration , 1986, Pattern Recognit..

[34]  Hugues Hoppe,et al.  Progressive meshes , 1996, SIGGRAPH.

[35]  Bogdan J. Matuszewski,et al.  Elastic image matching with embedded rigid structures using spring-mass system , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[36]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[37]  Thomas W. Sederberg,et al.  Image Reconstruction Using Data-Dependent Triangulation , 2001, IEEE Computer Graphics and Applications.

[38]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.