Robust Optical-to-SAR Image Matching Based on Shape Properties

Although image matching techniques have been developed in the last decades, automatic optical-to-synthetic aperture radar (SAR) image matching is still a challenging task due to significant nonlinear intensity differences between such images. This letter addresses this problem by proposing a novel similarity metric for image matching using shape properties. A shape descriptor named dense local self-similarity (DLSS) is first developed based on self-similarities within images. Then a similarity metric (named DLSC) is defined using the normalized cross correlation (NCC) of the DLSS descriptors, followed by a template matching strategy to detect correspondences between images. DLSC is robust against significant nonlinear intensity differences because it captures the shape similarity between images, which is independent of intensity patterns. DLSC has been evaluated with four pairs of optical and SAR images. Experimental results demonstrate its advantage over the state-of-the-art similarity metrics (such as NCC and mutual information), and show the superior matching performance.

[1]  Lorenzo Bruzzone,et al.  Robust Registration of Multimodal Remote Sensing Images Based on Structural Similarity , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Peter Reinartz,et al.  Mutual-Information-Based Registration of TerraSAR-X and Ikonos Imagery in Urban Areas , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Haigang Sui,et al.  Automatic Optical-to-SAR Image Registration by Iterative Line Extraction and Voronoi Integrated Spectral Point Matching , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Wenzhong Shi,et al.  Unsupervised Change Detection With Expectation-Maximization-Based Level Set , 2014, IEEE Geoscience and Remote Sensing Letters.

[5]  Chunhong Pan,et al.  Registration of Optical and SAR Satellite Images by Exploring the Spatial Relationship of the Improved SIFT , 2013, IEEE Geoscience and Remote Sensing Letters.

[6]  Y. Ye,et al.  HOPC: A NOVEL SIMILARITY METRIC BASED ON GEOMETRIC STRUCTURAL PROPERTIES FOR MULTI-MODAL REMOTE SENSING IMAGE MATCHING , 2016 .

[7]  B. S. Manjunath,et al.  A contour-based approach to multisensor image registration , 1995, IEEE Trans. Image Process..

[8]  Eli Shechtman,et al.  Matching Local Self-Similarities across Images and Videos , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Yuanxin Ye,et al.  A local descriptor based registration method for multispectral remote sensing images with non-linear intensity differences , 2014 .

[10]  Li Shen,et al.  Automatic matching of optical and SAR imagery through shape property , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[11]  Yacov Hel-Or,et al.  Matching by Tone Mapping: Photometric Invariant Template Matching , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[13]  Luís Corte-Real,et al.  CHAIR: automatic image registration based on correlation and Hough transform , 2012 .

[14]  Lei Huang,et al.  Feature-based image registration using the shape context , 2010 .

[15]  Luís Corte-Real,et al.  Automatic image registration based on correlation and Hough transform , 2008, Remote Sensing.

[16]  Jianglin Ma,et al.  Fully Automatic Subpixel Image Registration of Multiangle CHRIS/Proba Data , 2010, IEEE Transactions on Geoscience and Remote Sensing.