An Approach to Fine Coregistration Between Very High Resolution Multispectral Images Based on Registration Noise Distribution

Even after applying effective coregistration methods, multitemporal images are likely to show a residual misalignment, which is referred to as registration noise (RN). This is because coregistration methods from the literature cannot fully handle the local dissimilarities induced by differences in the acquisition conditions (e.g., the stability of the acquisition platform, the off-nadir angle of the sensor, the structure of the considered scene, etc.). This paper addresses the problem of reducing such a residual misalignment by proposing a fine automatic coregistration approach for very high resolution (VHR) multispectral images. The proposed method takes advantage of the properties of the residual misalignment itself. To this end, RN is first extracted in the change vector analysis (CVA) polar domain according to the behaviors of the specific multitemporal images considered. Then, a local analysis of RN pixels (i.e., those showing residual misalignment) is conducted for automatically extracting control points (CPs) and matching them according to their estimated displacement. Matched CPs are used for generating a deformation map by interpolation. Finally, one VHR image is warped to the coordinates of the other through a deformation map. Experiments carried out on simulated and real multitemporal VHR images confirm the effectiveness of the proposed approach.

[1]  Lorenzo Bruzzone,et al.  A minimum-cost thresholding technique for unsupervised change detection , 2000 .

[2]  Christopher Justice,et al.  The impact of misregistration on change detection , 1992, IEEE Trans. Geosci. Remote. Sens..

[3]  Yun Zhang,et al.  A Novel Interest-Point-Matching Algorithm for High-Resolution Satellite Images , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Chunhong Pan,et al.  Multilevel SIFT Matching for Large-Size VHR Image Registration , 2012, IEEE Geoscience and Remote Sensing Letters.

[5]  Li Wang,et al.  A robust multisource image automatic registration system based on the SIFT descriptor , 2012 .

[6]  Francesca Bovolo,et al.  A Context-Sensitive Technique Robust to Registration Noise for Change Detection in VHR Multispectral Images , 2010, IEEE Transactions on Image Processing.

[7]  Tianfu Wang,et al.  Multispectral Image Matching Using Rotation-Invariant Distance , 2011, IEEE Geoscience and Remote Sensing Letters.

[8]  Dengrong Zhang,et al.  A fast and fully automatic registration approach based on point features for multi-source remote-sensing images , 2008, Comput. Geosci..

[9]  Francesca Bovolo,et al.  Analysis and Adaptive Estimation of the Registration Noise Distribution in Multitemporal VHR Images , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[10]  R. Sibson,et al.  A brief description of natural neighbor interpolation , 1981 .

[11]  Amin Sedaghat,et al.  Uniform Robust Scale-Invariant Feature Matching for Optical Remote Sensing Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Yuanxin Ye,et al.  A local descriptor based registration method for multispectral remote sensing images with non-linear intensity differences , 2014 .

[13]  Youkyung Han,et al.  Automatic Registration of High-Resolution Images Using Local Properties of Features , 2012 .

[14]  Francesca Bovolo,et al.  A Split-Based Approach to Unsupervised Change Detection in Large-Size Multitemporal Images: Application to Tsunami-Damage Assessment , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[15]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[16]  David A. Clausi,et al.  ARRSI: Automatic Registration of Remote-Sensing Images , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Andrew Zisserman,et al.  Computer vision applied to super resolution , 2003, IEEE Signal Process. Mag..

[18]  Lorenzo Bruzzone,et al.  An adaptive approach to reducing registration noise effects in unsupervised change detection , 2003, IEEE Trans. Geosci. Remote. Sens..

[19]  IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, VOL. 34. NO. 4, JULY 1996 Universal Multifractal Scaling of Synthetic , 1996 .

[20]  Jordi Inglada,et al.  Analysis of Artifacts in Subpixel Remote Sensing Image Registration , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[21]  E. Parzen On Estimation of a Probability Density Function and Mode , 1962 .

[22]  Peter Reinartz,et al.  Applicability of the SIFT operator to geometric SAR image registration , 2010 .

[23]  Maoguo Gong,et al.  A Novel Coarse-to-Fine Scheme for Automatic Image Registration Based on SIFT and Mutual Information , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Yang Huachao,et al.  Robust and Precise Registration of Oblique Images Based on Scale-Invariant Feature Transformation Algorithm , 2012, IEEE Geoscience and Remote Sensing Letters.

[25]  Won Hee Lee,et al.  Automatic cloud detection for high spatial resolution multi-temporal images , 2014 .

[26]  Kai-Kuang Ma,et al.  Unsupervised Change Detection for Satellite Images Using Dual-Tree Complex Wavelet Transform , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Peng Gong,et al.  Registration-noise reduction in difference images for change detection , 1992 .

[28]  Lorenzo Bruzzone,et al.  A registration-noise driven technique for the alignment of VHR remote sensing images , 2010, 2010 IEEE International Geoscience and Remote Sensing Symposium.

[29]  Jordi Inglada,et al.  On the possibility of automatic multisensor image registration , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[31]  Peter Reinartz,et al.  Mutual-Information-Based Registration of TerraSAR-X and Ikonos Imagery in Urban Areas , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Warren B. Cohen,et al.  Automated designation of tie-points for image-to-image coregistration , 2003 .

[33]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[34]  Jitendra Malik,et al.  Blobworld: Image Segmentation Using Expectation-Maximization and Its Application to Image Querying , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Luís Corte-Real,et al.  Automatic Image Registration Through Image Segmentation and SIFT , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Wei Wang,et al.  Automatic Line Segment Registration Using Gaussian Mixture Model and Expectation-Maximization Algorithm , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[37]  Javier González,et al.  Improving Piecewise Linear Registration of High-Resolution Satellite Images Through Mesh Optimization , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Jianguo Liu,et al.  Phase correlation pixel‐to‐pixel image co‐registration based on optical flow and median shift propagation , 2008 .

[39]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  Chunhong Pan,et al.  Registration of Optical and SAR Satellite Images by Exploring the Spatial Relationship of the Improved SIFT , 2013, IEEE Geoscience and Remote Sensing Letters.

[41]  Kidiyo Kpalma,et al.  An automatic image registration for applications in remote sensing , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[42]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[43]  Lorenzo Bruzzone,et al.  Automatic analysis of the difference image for unsupervised change detection , 2000, IEEE Trans. Geosci. Remote. Sens..

[44]  Vicente Arévalo,et al.  An experimental evaluation of non‐rigid registration techniques on Quickbird satellite imagery , 2008 .

[45]  Yongil Kim,et al.  Parameter Optimization for the Extraction of Matching Points Between High-Resolution Multisensor Images in Urban Areas , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[46]  Yun Zhang,et al.  An IHS and wavelet integrated approach to improve pan-sharpening visual quality of natural colour IKONOS and QuickBird images , 2005, Inf. Fusion.

[47]  Francesca Bovolo,et al.  A Theoretical Framework for Unsupervised Change Detection Based on Change Vector Analysis in the Polar Domain , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Yun Zhang,et al.  Wavelet-based image registration technique for high-resolution remote sensing images , 2008, Comput. Geosci..